-- Logs begin at Fri 2022-05-27 14:22:53 UTC, end at Fri 2022-05-27 15:37:58 UTC. -- May 27 14:59:50.099724 dv-cinder-842542-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 14:59:50.108320 dv-cinder-842542-2-smb devstack@keystone.service[80524]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 14:59:50 2022] *** May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: nodename: dv-cinder-842542-2-smb May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: machine: x86_64 May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: clock source: unix May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: pcre jit disabled May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: detected number of CPU cores: 4 May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: current working directory: / May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: detected binary path: /usr/bin/uwsgi-core May 27 14:59:50.110361 dv-cinder-842542-2-smb devstack@keystone.service[80524]: your processes number limit is 47680 May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: your memory page size is 4096 bytes May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: detected max file descriptor number: 2048 May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: lock engine: pthread robust mutexes May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: thunder lock: enabled May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 14:59:50.111058 dv-cinder-842542-2-smb devstack@keystone.service[80524]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 14:59:50.156085 dv-cinder-842542-2-smb devstack@keystone.service[80524]: Python main interpreter initialized at 0x55ba815449c0 May 27 14:59:50.156085 dv-cinder-842542-2-smb devstack@keystone.service[80524]: python threads support enabled May 27 14:59:50.156085 dv-cinder-842542-2-smb devstack@keystone.service[80524]: your server socket listen backlog is limited to 100 connections May 27 14:59:50.156085 dv-cinder-842542-2-smb devstack@keystone.service[80524]: your mercy for graceful operations on workers is 90 seconds May 27 14:59:50.156448 dv-cinder-842542-2-smb devstack@keystone.service[80524]: mapped 403077 bytes (393 KB) for 2 cores May 27 14:59:50.156520 dv-cinder-842542-2-smb devstack@keystone.service[80524]: *** Operational MODE: preforking *** May 27 14:59:50.156814 dv-cinder-842542-2-smb devstack@keystone.service[80524]: *** uWSGI is running in multiple interpreter mode *** May 27 14:59:50.156814 dv-cinder-842542-2-smb devstack@keystone.service[80524]: spawned uWSGI master process (pid: 80524) May 27 14:59:50.156962 dv-cinder-842542-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 14:59:50.158069 dv-cinder-842542-2-smb devstack@keystone.service[80524]: spawned uWSGI worker 1 (pid: 80535, cores: 1) May 27 14:59:50.158069 dv-cinder-842542-2-smb devstack@keystone.service[80524]: spawned uWSGI worker 2 (pid: 80536, cores: 1) May 27 14:59:50.158069 dv-cinder-842542-2-smb devstack@keystone.service[80524]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 14:59:55.868483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:59:55.868483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: from cryptography.utils import int_from_bytes May 27 14:59:55.869279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:59:55.869279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: from cryptography.utils import int_from_bytes May 27 14:59:55.869394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:59:55.869394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: from cryptography.utils import int_from_bytes May 27 14:59:55.869394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:59:55.869394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: from cryptography.utils import int_from_bytes May 27 14:59:55.919416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:59:55.919589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:59:55.919685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:59:55.919774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:59:55.919853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] command line args: [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:59:55.919962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] command line args: [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:59:55.920046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:59:55.920215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ================================================================================ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:59:55.920300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:59:55.920377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ================================================================================ {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:59:55.920478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] admin_token = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.920631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] admin_token = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.920716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_dir = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.920874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] config_dir = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.920959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_source = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] debug = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] config_source = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] debug = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.921976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.922897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_config_append = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_config_append = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_dir = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_dir = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_file = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.923908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.924988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.925960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.926801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] publish_errors = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] publish_errors = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.927903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] standard_threads = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.928914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] standard_threads = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] use_journal = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] use_json = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_journal = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] use_stderr = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.929932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_json = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] use_syslog = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_stderr = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_syslog = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:59:55.930532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.930710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.930800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.930952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.931928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932245 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.932975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.933889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.934886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.935854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.936959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.937976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.938938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.939988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.940982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.941911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.942908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.943947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944874 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.944965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.945870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.946847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.947949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.948974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.949903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.950890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.951975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.952959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.953871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.954854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.external = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.external = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.955976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.password = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] auth.token = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.password = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.token = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.956982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.957913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.958066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.958145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.958848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.958929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.959909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.960895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.961890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.962889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.963991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.964957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.965927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.966882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.967999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.968930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.969982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.970842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.971948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.972911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.973774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.974511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.974664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.974733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.974918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975463 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.975935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.976899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.977997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.978948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.979986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.980916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.981999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.982980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.983986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.984921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.985858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.986975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.987936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.988997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.989899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] role.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] role.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.990922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.991920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992414 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.992973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.993939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.994830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.995966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.996994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.997955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.998909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:55.999859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.000975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001463 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.001987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.002959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.connection = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.003973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.004896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.005919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.006894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:59:56.007737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:59:56.007888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:59:56.039270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.039495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.039721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.039806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.040030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.040255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.048353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.048845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.077818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.078039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.078126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.078331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.131317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.133539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.182316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.182565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.183491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.183729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.248400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.248630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.248847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.248934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.249929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.273640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.273754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.273864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.273964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.274870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.275001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.275093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.286861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.287038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.299947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.300797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 14:59:56.320260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.320480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 14:59:56.320798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.320893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.321001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 14:59:56.321111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 14:59:56.321264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.321375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.321515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.321618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 14:59:56.321771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.321856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.322020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.322102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.322312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.322604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.332965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.333386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.333729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.333812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.334011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.334108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.334352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.334667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.342088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.342802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.345354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.345628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.345903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.346184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.346939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.347952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.348133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.348215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.348405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.348678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.349815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.375099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.376459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.376820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.377093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.378254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.378572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.383106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.383331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.383600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.384462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.384740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.385035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.391101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.391378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.392655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.392937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.396421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.396822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.397104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.397383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.397659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.397932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.398199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.398282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.398485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.398638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.398939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.399230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.399505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.399776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.400059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.400335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.417362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.417636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.419143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.419420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.422282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.424109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.425927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.426219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.427901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.428227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.431346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.433277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.434941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.436879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.438681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.438984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.439265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.439545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.439825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.440111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.440676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.440976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.441260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.441546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.441834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.442125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.460138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.460410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.460673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.460932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.462342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.462650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.462918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.463179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.468892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.470615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.470894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.471209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.472904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.473184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.473989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.474517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.474517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.474780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.475050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.476621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.476902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.477180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.477455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.477735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.488320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.488597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.488876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.489154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.489460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.489969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.489969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.491159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.491436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.491719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.491997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.492276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.492548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.492827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.508603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.511623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.512096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.514906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.515521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.517103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.518194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.518722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.519004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.519302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.519826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.521547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.521822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.522100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.526965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.528554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.529527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.531171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.531782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.532065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.532340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.532614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.534444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.534735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.535020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.535298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.542263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.542569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.542946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.550780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.551057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.551333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.551416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.551607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.551705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.551969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.552614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.553054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.553296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.553582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.553859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.554140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.554447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.554711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.554973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.555235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.560421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 14:59:56.560703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.560982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.561258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.561537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.561812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.562109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.562376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.562672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.562945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.563218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.563477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.563748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.564022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 14:59:56.594180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba815449c0 pid: 80536 (default app) May 27 14:59:56.597398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432948fe-22c0-411c-a477-2f1b392e2bdb None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:59:56.597687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432948fe-22c0-411c-a477-2f1b392e2bdb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:59:56.597965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432948fe-22c0-411c-a477-2f1b392e2bdb None None] PATH_INFO: `/v3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:59:56.602839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 791 bytes} [Fri May 27 14:59:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:59:56.603813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba815449c0 pid: 80535 (default app) May 27 15:00:05.333331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:05.333907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:05.333907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:05.335917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:05.343329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:05.343755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:05.343901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:05.413522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: INFO dbcounter [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] Registered counter for database keystone May 27 15:00:05.434388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:00:05.440680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writer thread running {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:00:05.620918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG passlib.handlers.bcrypt [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80535) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 15:00:05.621265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG passlib.handlers.bcrypt [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80535) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 15:00:05.717424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:05.719037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:05.843307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1/3] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 15:00:05.992911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:06.064140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: INFO dbcounter [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] Registered counter for database keystone May 27 15:00:06.084872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG oslo_db.sqlalchemy.engines [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:00:06.091972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writer thread running {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:00:06.212606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175ddb-b79b-4f3d-b334-e5e5bb60c5b5 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:06.216940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:06.217599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:06.217884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:06.218160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:06.226325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:06.277755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING keystone.common.rbac_enforcer.enforcer [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 15:00:06.278089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8a5e2-b8c3-4430-8318-0371e5f777cd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:06.288011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1324 bytes} [Fri May 27 15:00:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:00:06.294099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:06.309649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c557f-5fd6-4842-82c8-f5ecfbe89897 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:06.314035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:06.315179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:06.315498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:06.315771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] PATH_INFO: `/v3/projects/96792dba09744fc9ab793949f57108dd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:06.317573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] RBAC: Authorizing `identity:get_project(project_id=96792dba09744fc9ab793949f57108dd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:06.476601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 15:00:06.477218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687cd4c-1aa2-4c53-899c-e54d05de345e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:06.481585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 2/5] 10.222.0.74 () {56 vars in 1207 bytes} [Fri May 27 15:00:06 2022] GET /identity/v3/projects/96792dba09744fc9ab793949f57108dd => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:08.688681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea86af-818d-485a-848b-849fe55cbd62 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:08.689227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea86af-818d-485a-848b-849fe55cbd62 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:08.689323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea86af-818d-485a-848b-849fe55cbd62 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:08.693533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 4/6] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:08.699033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:08.699453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:08.699596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:08.719671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:08.721178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:08.734547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 3/7] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 15:00:08.766493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea86af-818d-485a-848b-849fe55cbd62 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:08.778953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea86af-818d-485a-848b-849fe55cbd62 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:08.783105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:08.783737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:08.784023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:08.784298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:08.792684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:08.794492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae080-605a-40e9-858e-7a3d0c1841c1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:08.803768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 5/8] 10.222.0.74 () {58 vars in 1324 bytes} [Fri May 27 15:00:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:00:08.809392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:08.819190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2bdc-5e7c-49e8-9ec7-3ca74bcbc2e7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:08.823600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:08.824461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:08.824748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:08.825027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:08.826435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:08.828283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c682-c69c-4d89-96a1-09050676a72f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:08.829844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 4/9] 10.222.0.74 () {56 vars in 1198 bytes} [Fri May 27 15:00:08 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:11.131548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8cdb-c3fe-40e0-9f24-0825c4aee453 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.132083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8cdb-c3fe-40e0-9f24-0825c4aee453 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.132083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8cdb-c3fe-40e0-9f24-0825c4aee453 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.133491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:11.138892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.139306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.139451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.145201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb748-61d7-4b05-812b-64d8d0450851 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.146068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb748-61d7-4b05-812b-64d8d0450851 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.147006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbb748-61d7-4b05-812b-64d8d0450851 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.148520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 7/11] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:11.153546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.153841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.154118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.159501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:11.160646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:11.195013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG passlib.handlers.bcrypt [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80536) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 15:00:11.195441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG passlib.handlers.bcrypt [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80536) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 15:00:11.241453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 5/12] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:11.241846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:11.243461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:11.264932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.289354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.345443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 8/13] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:11.367988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.371030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6676ff2-4667-4eef-aff2-971b44833775 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.404771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.405437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.405729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.406013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.469808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77f7b0-35fb-41a0-9072-e2ce4f0b2190 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.472375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.476360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.477858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.502945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.508034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.509079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.509366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.509643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.522121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:11.533442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:11.534380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:11.535921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 9/14] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:11.541570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.582141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 6/15] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:00:11.588754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.641491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d256-d049-487e-8146-c6a42c21bd7a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.675169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.675842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.676131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.676411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.677208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:11.677519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.679000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.686789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154405d-6435-4d13-b965-4fb4abf14ea7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.690687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 10/16] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:11.696313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.709275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.722810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.722810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.722810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.722810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.724300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.732555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.734013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:00:11.754573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:11.755571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:11.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:00:11.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:00:11.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:00:11.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:11.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 7/17] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:11.762193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.795445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d426-b062-4d43-b8e3-bd4d775f071e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.828667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.829538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.829816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.830086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.831652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.833213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.835011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 11/18] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:11.840242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:11.861143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054e1d-4ab2-46e7-aeb8-ed238d177644 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.898150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.898854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.899142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.899422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.900146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:11.900456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.901857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.919969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 8/19] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:11.936278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:11.944117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f0ae-c9db-4f3f-8aa2-dabcf66eb713 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:11.980795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:11.981539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:11.981829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:11.982109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:11.983415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:11.984952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ef46c-b5bd-4228-81e8-264ecae96986 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:11.986703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 12/20] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:11.993755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:12.030159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:12.101629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7eb2-a56d-4f83-b1fd-a5d782dcb1c1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:12.139373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:12.140032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:12.140316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:12.140589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:12.141422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.domain.id=default, user.id=90db34a522d24d0a8b320230ceed48a6) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:12.141726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:12.143212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829611-e9ff-4d17-8496-4497b4818b8a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:12.150478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 9/21] 10.222.0.74 () {56 vars in 1322 bytes} [Fri May 27 15:00:11 2022] GET /identity/v3/role_assignments?user.id=90db34a522d24d0a8b320230ceed48a6&scope.domain.id=default&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:14.677416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d0da-5984-4bfe-bc0f-e88335e49a54 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:14.678439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d0da-5984-4bfe-bc0f-e88335e49a54 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:14.678951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d0da-5984-4bfe-bc0f-e88335e49a54 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:14.680583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 13/22] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:14.686541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45dbf5-263a-4453-b3f2-50aace2055e5 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:14.687434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45dbf5-263a-4453-b3f2-50aace2055e5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:14.687933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45dbf5-263a-4453-b3f2-50aace2055e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:14.714518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7c45dbf5-263a-4453-b3f2-50aace2055e5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:14.715747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7c45dbf5-263a-4453-b3f2-50aace2055e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:14.816233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 10/23] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:14.855883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d0da-5984-4bfe-bc0f-e88335e49a54 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:15.108267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d0da-5984-4bfe-bc0f-e88335e49a54 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:15.118088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964249f-3589-4779-9741-acd4187ceb2e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.118822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964249f-3589-4779-9741-acd4187ceb2e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.119326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964249f-3589-4779-9741-acd4187ceb2e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.122906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 11/24] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:15.127678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.128211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.128768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.161756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:15.162584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.162866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.163141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.164536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:15.165723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:15.186651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:15.188160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:00:15.207661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:15.209089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:15.209964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:00:15.209964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:00:15.209964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:00:15.209964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:15.211957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 14/25] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:15.219487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:15.220757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:15.242944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:15.291075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 12/26] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:15.354119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:15.399408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b378bdf-fbfb-45c7-b3ac-7b6f85af2ea0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:15.464875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:15.466492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.467008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.467506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.468443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:15.468969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:15.470605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451f6c2-61e0-496e-a2e0-8bece148a87e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:15.495366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 15/27] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:15.498795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba911-2aaa-496a-8fed-f7bad75cff69 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.499582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba911-2aaa-496a-8fed-f7bad75cff69 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.501165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba911-2aaa-496a-8fed-f7bad75cff69 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.503952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 16/28] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:15.506190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fba911-2aaa-496a-8fed-f7bad75cff69 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:15.544691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412681ac-4508-4ff3-b9eb-cbf0612f892d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:15.594919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:15.596627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.597121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.597824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.614730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:15.622801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5f22d6e3-4854-4e95-a2a2-9a2bc9979593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:15.628288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:15.629147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:15.629971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:15.632836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 13/29] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:15.641784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a547-c299-43d1-a454-fbaf14af3a2a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.641784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a547-c299-43d1-a454-fbaf14af3a2a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.641784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a547-c299-43d1-a454-fbaf14af3a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.654910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fba911-2aaa-496a-8fed-f7bad75cff69 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:15.658614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d810a547-c299-43d1-a454-fbaf14af3a2a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:15.660007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d810a547-c299-43d1-a454-fbaf14af3a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:15.680563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:15.699609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:15.700974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.701705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.702509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.703447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:15.705051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:15.747500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 14/30] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:15.750604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115baa21-12c7-408c-b98b-93581d22ba6e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.750604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115baa21-12c7-408c-b98b-93581d22ba6e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.750604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115baa21-12c7-408c-b98b-93581d22ba6e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.752643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 15/31] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:15.753669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115baa21-12c7-408c-b98b-93581d22ba6e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:15.868444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115baa21-12c7-408c-b98b-93581d22ba6e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:15.905756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:15.906789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.907310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.907793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.908758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:15.909375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:15.912211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8aa5c-eb5d-4f3e-951f-eb92f500e11e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:15.925463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 16/32] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:15.927997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abb72e-5cbc-4d58-98a6-fd49e5de767f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:15.928498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abb72e-5cbc-4d58-98a6-fd49e5de767f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:15.928986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abb72e-5cbc-4d58-98a6-fd49e5de767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:15.946705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-59abb72e-5cbc-4d58-98a6-fd49e5de767f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:15.948190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-59abb72e-5cbc-4d58-98a6-fd49e5de767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:15.951284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:15.969474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 17/33] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:00:15 2022] POST /identity/v3/projects => generated 301 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:15.970470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.062887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 17/34] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:16.064612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500558d-e908-4e4e-b66d-1de5720f3914 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.064917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500558d-e908-4e4e-b66d-1de5720f3914 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.065199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500558d-e908-4e4e-b66d-1de5720f3914 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.066901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 18/35] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:16.068314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500558d-e908-4e4e-b66d-1de5720f3914 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.102023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce27d-c2f2-4da6-9ab7-7a453566ea00 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.135006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:16.146851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.148062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.148548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.149049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.150796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.152190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ebab-0d85-4b88-b7df-9666e2976aa9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.207741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500558d-e908-4e4e-b66d-1de5720f3914 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.241636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 18/36] 10.222.0.74 () {60 vars in 1131 bytes} [Fri May 27 15:00:15 2022] POST /identity/v3/roles => generated 219 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:16.243411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.243898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.244185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.257218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.259593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.260283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.260774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.262705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.264574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.266653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 19/37] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:16 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:16.267671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.269040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:16.271465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:16.287775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:16.381414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 19/38] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:16.382682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.417224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb6a5b-f45a-490e-8fc8-3271558f2b80 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.470023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.471584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.471877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.472164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.473194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.475979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ce8e-0b0f-4639-8a4a-7db65895711e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.510849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16969-0562-4034-9de5-f7a8c69d7a5d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.530204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:16.547522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.548334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.548626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.548912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.550101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.551595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.553353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 20/39] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:16.554110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.652119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 20/40] 10.222.0.74 () {60 vars in 1131 bytes} [Fri May 27 15:00:16 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:16.653658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8c85-2e5d-49e5-8c7f-dbb7d0ead14b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.653956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8c85-2e5d-49e5-8c7f-dbb7d0ead14b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.654238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8c85-2e5d-49e5-8c7f-dbb7d0ead14b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.655533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 21/41] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:16.656236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc8c85-2e5d-49e5-8c7f-dbb7d0ead14b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.672002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644b1a9-ca5f-477c-bcc2-ea1a21cba017 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.712027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.712820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.713207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.713319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.714087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.715558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d946390-c4bf-4ebe-a2ad-1b22e2b3d8d6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.738349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:16.776136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc8c85-2e5d-49e5-8c7f-dbb7d0ead14b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:16.782789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 21/42] 10.222.0.74 () {60 vars in 1131 bytes} [Fri May 27 15:00:16 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:16.784204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.784598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.784978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.804978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:16.806485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:16.834313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:16.835651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:16.835948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:16.836236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] PATH_INFO: `/v3/domains/default/users/90db34a522d24d0a8b320230ceed48a6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:16.839894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=90db34a522d24d0a8b320230ceed48a6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:16.842675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:16.860027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:16.897757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 22/43] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:16.922702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:16.925587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 22/44] 10.222.0.74 () {58 vars in 1361 bytes} [Fri May 27 15:00:16 2022] PUT /identity/v3/domains/default/users/90db34a522d24d0a8b320230ceed48a6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:17.046731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0a1a-b939-4eae-80e9-51a375e401ec None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:17.084840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:17.085656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:17.085943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:17.086227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:17.087494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:17.088984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17363a7e-860d-45b4-bef7-bef3a908e741 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:17.090716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 23/45] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:17.096568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:17.200385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aed50b-6a14-4d29-a024-8843e40cefc8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:17.226152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:17.233707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:17.234365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:17.234677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:17.234958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:17.235669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:17.237133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2f6c-6bdd-47fe-95de-3bb7895ea206 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:17.343177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 23/46] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:00:17 2022] POST /identity/v3/projects => generated 312 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:19.187538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd05ca-759b-4d0b-a7b1-63d94e76443e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.188039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd05ca-759b-4d0b-a7b1-63d94e76443e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.188122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd05ca-759b-4d0b-a7b1-63d94e76443e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.189499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 24/47] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:19.195753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.196152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.196326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.213301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:19.214871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:19.280972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 24/48] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:19.304294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd05ca-759b-4d0b-a7b1-63d94e76443e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.347990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:19.407990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd05ca-759b-4d0b-a7b1-63d94e76443e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.443123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.443989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.444276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.444553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.454509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8a959ade-4257-4d82-93f9-159ed1e6e896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:19.462932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:19.463780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:19.464553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 25/49] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:19.469977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.565470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9230da-0c12-4451-b1ff-98ae5fb0be63 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.576582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:19.577832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204eef-2d46-4272-be71-eb202800a227 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.578188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204eef-2d46-4272-be71-eb202800a227 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.578582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204eef-2d46-4272-be71-eb202800a227 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.580027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 26/50] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:19.585557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.587978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.587978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.601610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.602284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.602597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.602880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.603111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:19.603626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:19.603936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:19.604306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:19.605327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:19.613529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 25/51] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:19.619174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.675133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 27/52] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:19.699567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.722155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c63d69-9080-46b6-8273-d4d8163b9c9b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.729629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:19.757430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.758313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.758632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.758910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.760124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:19.761917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:19.763593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:19.769108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.798357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f46a-869c-4ed6-b711-a753bb0f43f2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.811303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:19.834225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.835060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.835354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.835636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.836823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:19.838287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:19.839943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 28/54] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:19.845385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.871684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62836-5055-4cff-a89c-5a935296e847 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.912583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.913385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.913674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.913954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.915166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:19.916673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:19.918304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:19.924132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:19.942940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:19.945885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ec541-7e85-478a-a84e-5dd50abace52 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:19.980573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:19.981165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:19.981451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:19.981728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:19.982458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:19.983964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8648bdb-9e6b-44dd-b3e4-0ecafd818f9f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:20.026053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8776a-8ded-49d9-8a43-da9442d82ab2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:20.034746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:20.058991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:20.059648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:20.059939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:20.060219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:20.061053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.domain.id=default, user.id=90db34a522d24d0a8b320230ceed48a6) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:20.061428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:20.062873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14403-82d8-4b28-a26a-6b5fe21bd790 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:20.069220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 28/56] 10.222.0.74 () {56 vars in 1322 bytes} [Fri May 27 15:00:19 2022] GET /identity/v3/role_assignments?user.id=90db34a522d24d0a8b320230ceed48a6&scope.domain.id=default&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:20.090364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 29/57] 10.222.0.74 () {60 vars in 1140 bytes} [Fri May 27 15:00:19 2022] POST /identity/v3/projects => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:00:22.322802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1bdc-4ff1-484f-8407-5d0879511262 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:22.323357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1bdc-4ff1-484f-8407-5d0879511262 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:22.323357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1bdc-4ff1-484f-8407-5d0879511262 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:22.324741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 29/58] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:22.329853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:22.330245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:22.330443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:22.347372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:22.349147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:22.412602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 30/59] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:22.436526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1bdc-4ff1-484f-8407-5d0879511262 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:22.535089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1bdc-4ff1-484f-8407-5d0879511262 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:22.566393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:22.567686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:22.567967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:22.568289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:22.569390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:22.570859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a40ae-2816-4e73-b09b-c6e94582a84b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:22.572445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 30/60] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:22.577858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:22.655799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:22.672562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62e508-74ea-476e-8df4-7c9ad168339d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:22.705330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:22.705997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:22.706282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:22.706589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:22.707307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:22.709446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a3e7-0658-4c7d-b6c3-aa7b7d49a2af None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:22.813752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 31/61] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:22 2022] POST /identity/v3/users => generated 275 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:25.948602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62bb29-ee50-45f3-84aa-1138926191de None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:25.949585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62bb29-ee50-45f3-84aa-1138926191de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:25.950060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62bb29-ee50-45f3-84aa-1138926191de None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:25.951662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 31/62] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:25.956832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c70f-fbfe-4a2c-876a-ace3a8758c0a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:25.957628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c70f-fbfe-4a2c-876a-ace3a8758c0a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:25.958276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c70f-fbfe-4a2c-876a-ace3a8758c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:25.983506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d346c70f-fbfe-4a2c-876a-ace3a8758c0a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:25.984754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d346c70f-fbfe-4a2c-876a-ace3a8758c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:26.084592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 32/63] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:26.132940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62bb29-ee50-45f3-84aa-1138926191de None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.193031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:26.267572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62bb29-ee50-45f3-84aa-1138926191de None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:26.316580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:26.317918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.318192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.318524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.339315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:26.347195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:26.348065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:26.349374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 32/64] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:26.354112 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba491-86ba-428e-9889-475696a53366 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.354433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba491-86ba-428e-9889-475696a53366 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.354720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba491-86ba-428e-9889-475696a53366 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.356116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 33/65] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:26.358907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.363710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.364027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.364353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.384196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:26.385653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:26.503489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:26.513944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 34/66] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:26.545020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.554081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:26.557657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b9c3-3d87-4d04-9b8a-ac722fcec0bd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:26.595919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:26.596606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.596897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.597183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.598052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:26.599029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:26.600462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446186f9-04cb-42a7-abe4-3d69a461a10a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:26.609263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 33/67] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:26.614932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9471b-dcd4-45b8-9e4b-c428254c57ab None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.615507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9471b-dcd4-45b8-9e4b-c428254c57ab None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.615881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9471b-dcd4-45b8-9e4b-c428254c57ab None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.617573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 34/68] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:26.622176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9471b-dcd4-45b8-9e4b-c428254c57ab None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.692710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a2e0-3902-4158-a488-236cf4d4b0c7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:26.743623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9471b-dcd4-45b8-9e4b-c428254c57ab None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:26.747039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:26.747711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.747999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.748278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.764934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-04299b4d-a00d-4b25-9b47-05fc684982e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:26.776741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:26.777686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:26.778471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:26.780391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 35/69] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:26.782567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.782856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.783135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.792555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:26.794145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.794697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.796169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.810259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:26.811600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:26.816400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:26.818253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:26.820277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 35/70] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:26.821992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.853256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:26.872232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:26.887028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 36/71] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:26.887936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:26.956629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139371e-39b5-4dfa-8284-a957519a5f1e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:26.994696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:26.995375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:26.995658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:26.995943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:26.996683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:26.996988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:26.998374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb299cc-b48c-4164-9a97-482d87257a07 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.004362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dc44-6670-4b2d-8cb6-fdc7f9329746 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.007227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 36/72] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.011094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fed283-664b-40d7-b92e-a2218a9998a3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.011656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fed283-664b-40d7-b92e-a2218a9998a3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.011945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fed283-664b-40d7-b92e-a2218a9998a3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.013244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 37/73] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:27.014437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fed283-664b-40d7-b92e-a2218a9998a3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.040681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.041252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.041537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.041820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.095806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.096873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.108912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.110431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e708-95fb-4132-ad30-186369f2b688 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.115574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fed283-664b-40d7-b92e-a2218a9998a3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.150431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.151285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.151568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.151849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.162024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e2762dd7-b9cf-4ce1-a1fd-eb18489009ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:27.170159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:27.171193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:27.171968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 38/74] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:27.172602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd412-646f-43c7-a9ca-db62ce33c1de None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.172857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd412-646f-43c7-a9ca-db62ce33c1de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.173142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd412-646f-43c7-a9ca-db62ce33c1de None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.174385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 39/75] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:27.175101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd412-646f-43c7-a9ca-db62ce33c1de None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.216146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 37/76] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:27.217447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.217739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.218028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.233740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:27.234920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:27.284662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd412-646f-43c7-a9ca-db62ce33c1de None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.314468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 38/77] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:27.314468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.318858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.319732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.320022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.320291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.321472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.321587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.322966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3f40-fa72-4709-9207-379bfec6f5fa None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.324620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 40/78] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.325872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.326161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.326452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.343061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:27.344243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:27.347031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.404904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc8ee-49c9-4115-ae14-9d3d3ab1279d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.410724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 41/79] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:27.411759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.443305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.443974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.444257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.444533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.445274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:27.445592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.447009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.454915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 39/80] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.455697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.511662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f44bbc-000a-411a-9aec-4563bfe544d8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.537608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.545113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.545976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.546262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.546572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.547746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.549214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.550944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 42/81] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.551908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.555829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b066-80a4-4955-a083-841ee3f964a0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.563665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.590199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.590959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.591247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.591528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.592763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.594213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.595865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 40/82] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.597586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.652788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a3734-847a-4da9-9267-97e10999827d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.687180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.687844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.688129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.688407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.695723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1900781-863a-4a59-95aa-a48e6c70dfe2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.728879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.729679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.729971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.730258 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.741286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:27.749138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:27.749991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:27.750801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 41/83] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:27.751452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.757912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.759435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.763721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.769197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.852726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed138-78bc-4602-be1d-2d21baabca0d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.856003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 43/84] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:27.856839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.887912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.888792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.889081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.889362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.890578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.892044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:27.893686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 42/85] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:27.894461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:27.959894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de0b6-4722-4b65-ba8f-5a55e7fe3c49 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.968803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.970439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:27.992065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa71c1-d13e-4740-85be-53396f7c1bf7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:27.993024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:27.993687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:27.993977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:27.994258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:27.995133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=bff283621e36422286533f104dc729c2, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:27.995453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:27.996909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.002193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 44/86] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:27 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=bff283621e36422286533f104dc729c2&role.id=239334dd0e7f463ea1f77dce601caeff => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.003023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.027998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.028700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.029148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.029440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.030185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.031859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.107920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 43/87] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:27 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:28.109891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.133143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a0ae-7dc9-4981-ad65-01e0befe711f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.186348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.187102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.187392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.188383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.189190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:28.189570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.191081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.201371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 45/88] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.206285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.241715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953ca96-7343-4e06-ae3d-864fafc05e0b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.246750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.275975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.281070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.282030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.282309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.282640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.284011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.285621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.294269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 44/89] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.295357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.341707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc22d-c9f6-4a3f-a552-74a67cf373b0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.384369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.385568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.385854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.386133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.434375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d7d9-c748-4393-8d7e-e7649ea0631b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.474016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.475999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.476891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.477791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.478086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.478372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.480644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.481859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.483575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 45/90] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.484378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.516702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.571557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.606332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 46/91] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:28.607187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.609773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1d42-1646-4c1c-8236-161d5a798ed6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.652654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.653253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.653544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.653825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.654695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=bff283621e36422286533f104dc729c2, user.id=90db34a522d24d0a8b320230ceed48a6) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:28.655017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.657756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.672769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 46/92] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/role_assignments?user.id=90db34a522d24d0a8b320230ceed48a6&scope.project.id=bff283621e36422286533f104dc729c2&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.673769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:28.862681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168e-358a-4906-b320-928aa511aa3c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.874133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944f5d-6307-401e-bda5-408e5b610a02 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:28.940168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.940352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.941000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.941290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.941574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.946702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:28.948246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:28.950028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:28.950317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:28.950624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:28.956465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:28.958047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:28.960014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 47/93] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:28.966834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:29.101907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:29.103417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:29.140469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24240-d206-40f1-b906-e50ba19621e0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:29.191196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:29.192983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:29.193279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:29.193728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:29.194611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=bff283621e36422286533f104dc729c2, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:29.194934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:29.196430 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:29.203443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 48/94] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=bff283621e36422286533f104dc729c2&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:29.293289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 47/95] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:29.298733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:29.385271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:29.435860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8cda-7a19-4ded-8847-2023f600a367 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:29.488832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:29.489724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:29.490016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:29.490299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] PATH_INFO: `/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:29.491652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] RBAC: Authorizing `identity:get_project(project_id=6abb7bd12bde4b0cb6bf020de89f9e22)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:29.493145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca30cd-6905-4af3-b731-7e8588546fcb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:29.495116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 49/96] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:29 2022] GET /identity/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:29.500928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:29.552180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:29.626972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5bf5-2f1f-4f58-9778-80e7e31c8be0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:29.670032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:29.670750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:29.671042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:29.671324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:29.672161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=6abb7bd12bde4b0cb6bf020de89f9e22, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:29.672478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:29.673932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4904-f2e2-4640-b10d-a1add5d2f401 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:29.681949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 48/97] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:29 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=6abb7bd12bde4b0cb6bf020de89f9e22&role.id=239334dd0e7f463ea1f77dce601caeff => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:31.138994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171b6e-a89b-4144-8e68-e3e66ec9f83a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.139499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171b6e-a89b-4144-8e68-e3e66ec9f83a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.139604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171b6e-a89b-4144-8e68-e3e66ec9f83a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.140957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 50/98] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:31.147486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3307-099d-4630-939a-4b10b746bab6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.147948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3307-099d-4630-939a-4b10b746bab6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.148136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3307-099d-4630-939a-4b10b746bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.175506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ac1d3307-099d-4630-939a-4b10b746bab6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:31.176779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ac1d3307-099d-4630-939a-4b10b746bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:31.257366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 49/99] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:31.295921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171b6e-a89b-4144-8e68-e3e66ec9f83a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:31.314347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf0b9-e7f1-40ea-872b-ed848b8606ef None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.314655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf0b9-e7f1-40ea-872b-ed848b8606ef None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.314939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf0b9-e7f1-40ea-872b-ed848b8606ef None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.316321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 50/100] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:31.331881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872af1e-26a1-49fc-9235-a1d87a8ccd72 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.332164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872af1e-26a1-49fc-9235-a1d87a8ccd72 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.332445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872af1e-26a1-49fc-9235-a1d87a8ccd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.354810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1872af1e-26a1-49fc-9235-a1d87a8ccd72 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:31.356349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1872af1e-26a1-49fc-9235-a1d87a8ccd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:31.403510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:31.456293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171b6e-a89b-4144-8e68-e3e66ec9f83a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:31.492779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:31.493909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.494333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.494777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.510627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:31.510797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 51/101] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:31.510797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587568d-9835-4d50-8a04-c6bbfb4832be None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.510797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587568d-9835-4d50-8a04-c6bbfb4832be None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.510797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587568d-9835-4d50-8a04-c6bbfb4832be None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.510797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 52/102] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:31.511115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:31.515855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.516149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.516436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:31.522539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:31.523671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:31.524644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 51/103] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:31.531352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:31.552358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:31.553595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:31.650382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3a5f2-024d-468a-93d9-d4f95666f43a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:31.689536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:31.690626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.691110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.691579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.693456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:31.693969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:31.695727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:31.709927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 52/104] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:31.711156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:31.767549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 53/105] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:31.768719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:31.778771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:31.849570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d959b-59cc-426f-9263-cbbec9017f24 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:31.894611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:31.895775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.896216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.896642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.898926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:31.901294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:31.903413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 53/106] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:31.908687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:31.914303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:31.928146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca483-2095-453e-98c8-aa91f2c0eeda None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:31.973228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:31.974776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.975072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.975359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.976899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:31.979091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435989f0-a7a5-4c01-8dc9-af9b2e3cd147 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:31.980767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 54/107] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:31 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:31.982160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b9fe-fb92-445c-a24f-4ecf40a1a0e8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:31.982642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b9fe-fb92-445c-a24f-4ecf40a1a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:31.983112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b9fe-fb92-445c-a24f-4ecf40a1a0e8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:31.984504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 55/108] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:31.985350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00b9fe-fb92-445c-a24f-4ecf40a1a0e8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.038264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79da096-033d-4320-9b97-ce1a6ce167c5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.063233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.078338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.080132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.080494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.080848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.096700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:32.108006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:32.109048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:32.110032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:32.111268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 54/109] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:32.112090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.117010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00b9fe-fb92-445c-a24f-4ecf40a1a0e8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.158910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.161890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.162343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.162840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.163698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:32.165339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94705da-6a23-4358-8818-d8e421f47a50 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:32.234470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890570a9-a4cc-47d3-b0be-cb81289fea46 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.263995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 56/110] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:00:31 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:32.266266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.266808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.267352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.289754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:32.291642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:32.292211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.293109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.293408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.293698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.295878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.297041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:32.302204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:32.302204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 55/111] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:32 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:32.307673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.419870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.439793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 57/112] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:32.440478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.535668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c313be-c644-4510-b05b-5606f678f7d9 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.577504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.578161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.578505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.578794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.579549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:32.579863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:32.581273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:32.591265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 56/113] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:32.592158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.611302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ead71-9f96-4a8b-986b-577b6ecefe86 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.666604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.667709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.667996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.668278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/users/f040341105664752ba9be38ec7dad1bd/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.670356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, user_id=f040341105664752ba9be38ec7dad1bd, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:32.671915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:32.717457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2123c-c092-439b-9f05-d367714a0e23 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.732660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.737495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.744996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 58/114] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:32 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/users/f040341105664752ba9be38ec7dad1bd/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:32.752375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.779754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:32.780605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.781928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.782764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.811186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-b53c42d4-028a-4d02-838d-ddc8229c3125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:32.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:32.821216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:32.822004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:32.824656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 57/115] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:32.826291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe845c9-9887-4c41-8ebf-bc63034dc721 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:32.826833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe845c9-9887-4c41-8ebf-bc63034dc721 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:32.827335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe845c9-9887-4c41-8ebf-bc63034dc721 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:32.829305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 58/116] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:32.834469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe845c9-9887-4c41-8ebf-bc63034dc721 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:32.966780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe845c9-9887-4c41-8ebf-bc63034dc721 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:32.967222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988532-500e-44fc-a09c-e84e51d05163 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.006701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.007828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.008372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.008884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.009874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:33.010398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.012381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8448-bbcc-4336-a83c-4f8a5f07bd36 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.023657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 59/117] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.025296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.025878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.026364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.045419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:33.047046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:33.060167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.061074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.061413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.061638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] PATH_INFO: `/v3/users/b905898b30ca452ea08461e569041320` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.077882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] RBAC: Authorizing `identity:get_user(user_id=b905898b30ca452ea08461e569041320)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.079563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.081562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 59/118] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:32 2022] GET /identity/v3/users/b905898b30ca452ea08461e569041320 => generated 289 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.082595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.083986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.131865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 60/119] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:33.132725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.162382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.218162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23012f-a603-4813-8ef9-e241154a0966 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.267469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.268388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7430-4e10-4958-b62d-46aaaf9b6544 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.268891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.269268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.269663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.271921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.275477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad16d05-88a8-4637-8aac-d225f1558edb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.278194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 60/120] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.280793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beff35-8c9a-4be0-bea7-b6f604841ada None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.281222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beff35-8c9a-4be0-bea7-b6f604841ada None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.281634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beff35-8c9a-4be0-bea7-b6f604841ada None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.284831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 61/121] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:33.287001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beff35-8c9a-4be0-bea7-b6f604841ada None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.321200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.322827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.323324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.324055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.371559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.411491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.413883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eeb47-557d-495b-9bdb-04f858dbb048 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.443686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beff35-8c9a-4be0-bea7-b6f604841ada None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.478253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.494743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.499933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.500224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.500500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.515576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:33.528150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:33.529093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:33.529879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 62/122] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:33.530606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.536743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 61/123] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:33.538298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.538839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.539338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.557022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:33.558623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:33.639775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.646381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 62/124] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:33.647609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.658725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f900e-a4f5-4184-8dcd-369a24961bea None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.750165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.751241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.751640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.752019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.753316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.754958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.756901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 63/125] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.757810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.807894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3a1e-e300-4808-9ce0-1f708b8abe00 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.819325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:33.856988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.857908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.858891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.859322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.860603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:33.861345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.863699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.872168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866088-d013-45bd-8e98-119aadfb996c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:33.875970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 63/126] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.876641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.920274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:33.921542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:33.922324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:33.922733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:33.924321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:33.926190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:33.933964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 64/127] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:33.933964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:33.965745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.027617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123303d2-46e4-491b-9229-5fca6623f6f1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.052709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a868fc-fa47-4f1b-962d-37b2fabdebb1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.074697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.077649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.079235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.080029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.080523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.089737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.090845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.090968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.091220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/users/90db34a522d24d0a8b320230ceed48a6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.093256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, user_id=90db34a522d24d0a8b320230ceed48a6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.094249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:34.094816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:34.103594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:34.104980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:34.105766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:34.106348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 64/128] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:34.110465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.214437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 65/129] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:33 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/users/90db34a522d24d0a8b320230ceed48a6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:34.214437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.248392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a50375-2bfe-48e2-873d-5fa363764848 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.286383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.332210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.333673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.333673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.334720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.338318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.340036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.341909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 65/130] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:34.342843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.385616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ec43-f478-48da-868f-99d2477e0ed1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.431738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.432625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.433016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.434281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.436972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, scope.project.id=bff283621e36422286533f104dc729c2, user.id=b905898b30ca452ea08461e569041320) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:34.437419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.439598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.451827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 66/131] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/role_assignments?user.id=b905898b30ca452ea08461e569041320&scope.project.id=bff283621e36422286533f104dc729c2&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:34.455173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.570882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.590822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736e7d-a8e3-4d29-8c0a-9221bfc80ac8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.666548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.667249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.667551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.667839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.668616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:34.668935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.670388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.681234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436e2d-1126-466b-96e8-b74a9542b264 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.686830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 66/132] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:34.695036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.742241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.743156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.743794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.743794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.745619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.747857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.749766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 67/133] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:34.758053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:34.772741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.880243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9a9a-d195-47db-b59e-9ff130fd172c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.917393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999f86-d765-46d1-8988-f8fab32f12fe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:34.931131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:34.953296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.954450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.954818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.955161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/users/f040341105664752ba9be38ec7dad1bd/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.958280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, user_id=f040341105664752ba9be38ec7dad1bd, role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.960027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82d227-b6bc-494a-adf9-bfd137a112b3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.967165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:34.968184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.968482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.968765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.970062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:34.971642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a63e-d8af-46b5-b837-de138386b8aa None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:34.974025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 67/134] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:34.975440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c07ca-5cc2-4efd-82a8-c72078e39643 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:34.975832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c07ca-5cc2-4efd-82a8-c72078e39643 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:34.976178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c07ca-5cc2-4efd-82a8-c72078e39643 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:34.977755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 68/135] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:34.983329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c07ca-5cc2-4efd-82a8-c72078e39643 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:35.028363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 68/136] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:34 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/users/f040341105664752ba9be38ec7dad1bd/roles/018279cf41c14fa5b5d2a962378262e8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:35.034585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.034585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.034585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.071511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:35.072866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:35.149563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c07ca-5cc2-4efd-82a8-c72078e39643 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:35.169355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:35.195761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:35.196654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.196953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.197349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] PATH_INFO: `/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.198525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] RBAC: Authorizing `identity:get_project(project_id=6abb7bd12bde4b0cb6bf020de89f9e22)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:35.200234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:35.202648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 69/137] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:34 2022] GET /identity/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:35.209241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:35.235868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 69/138] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:35.269804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:35.392013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865572f-387a-4ee1-8f40-372ae0d32094 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:35.435061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8c82-8d4e-4013-a134-0d51512c67d3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:35.437575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:35.438509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.438798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.439077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] PATH_INFO: `/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22/users/f040341105664752ba9be38ec7dad1bd/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.440064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:35.443245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6abb7bd12bde4b0cb6bf020de89f9e22, user_id=f040341105664752ba9be38ec7dad1bd, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:35.444714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e780c-31a1-4771-9533-e82a3726ead5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:35.481800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:35.482796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.483088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.483415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.484645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:35.486261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:35.488268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 70/139] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:35.493973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:35.554171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 70/140] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:35 2022] PUT /identity/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22/users/f040341105664752ba9be38ec7dad1bd/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:35.632609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc983f-f61f-4c68-8fcc-5a0bd6d233b8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:35.674451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:35.675156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.675445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.675726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.677038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:35.678509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:35.678661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d913-44bc-4222-99a7-d341cba3e65d None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.678875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d913-44bc-4222-99a7-d341cba3e65d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.679161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d913-44bc-4222-99a7-d341cba3e65d None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.683432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 71/141] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:35.686758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:35.686980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:35.687268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:35.715182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:35.719075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:35.759416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:35.800286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 71/142] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:35 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:00:35.810221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 72/143] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:35.864702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:35.923120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:36.020413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750818-d13c-42ca-bc8e-e3d0d78b3eb3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:36.071068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:36.071905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:36.072192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:36.072472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:36.084375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:36.094447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:36.096504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:36.098899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 72/144] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:36.107756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:36.258121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792ddb7-de5a-4371-adc8-7fe7baf86df8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:36.295265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:36.295965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:36.296251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:36.296528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:36.297284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:36.297589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:36.299113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:36.308671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 73/145] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:36.315538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:36.430784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:36.455562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f342-707a-4f9e-bdc9-feec3a2877c4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:36.495455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:36.496702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:36.497185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:36.497657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:36.499291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:36.500968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:36.502872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 73/146] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:36 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:36.509035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:36.568517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:36.649264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ecfe0-32ac-4ede-8dbc-72d63b0feeb8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:36.689703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:36.690368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:36.690684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:36.690962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:36.767500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:36.768991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:36.817512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:36.880899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 74/147] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:36.887031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:36.996536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4069-a6dd-40ee-9fe7-9bf023ddc08d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:37.033120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:37.033991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.034274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.034587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.035843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:37.037331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25c27d-782e-455a-9af8-1172386271a8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:37.039076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 74/148] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:36 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:37.047539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:37.181695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2248-3825-4501-96d8-cda6175d74db None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:37.235159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:37.236174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.236653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.237145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.238163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=bff283621e36422286533f104dc729c2, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:37.238727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:37.241032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238c072-83bf-4d07-bdca-6862eda79715 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:37.246802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:37.252271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 75/149] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:37 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=bff283621e36422286533f104dc729c2&role.id=239334dd0e7f463ea1f77dce601caeff => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:37.749506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f09fd-2aff-4334-bdda-4407d68262fe None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.750007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f09fd-2aff-4334-bdda-4407d68262fe None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.750080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f09fd-2aff-4334-bdda-4407d68262fe None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.751488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 75/150] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:37.757480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.757905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.758097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.776454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:37.777656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:37.827470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444403-3fda-4304-b54d-9b6054704a65 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.827763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444403-3fda-4304-b54d-9b6054704a65 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.828029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444403-3fda-4304-b54d-9b6054704a65 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.829394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 76/151] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:37.839993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:37.840280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:37.840561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:37.867101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:37.868307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:37.881941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 76/152] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:37.906852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:37.913652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.005546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 77/153] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:38.030173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ccb6b-cab7-427b-8749-ba3e7aaa451f None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.054823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.062789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.068204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.072715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.072715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.072715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.082011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:38.091026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:38.092823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:38.094551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 77/154] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:38.102530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.307490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7f332-afcb-4587-a743-20a32fe85b1d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.316540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b8bf0-f9af-4137-9fa0-725a097f065b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.352062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.352751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.353034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.353312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.354065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:38.354372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:38.355782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:38.365378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 78/155] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:38.371209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.424793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.425605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.425882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.426154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.439057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.459419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:38.467173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:38.468085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:38.468965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 78/156] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:38.474616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.494072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2bf7d-67b0-4119-af61-66f2b2c4fed7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.509512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.539720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.540653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.540938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.541215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] PATH_INFO: `/v3/users/b905898b30ca452ea08461e569041320` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.542434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] RBAC: Authorizing `identity:get_user(user_id=b905898b30ca452ea08461e569041320)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:38.543996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:38.545808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 79/157] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/users/b905898b30ca452ea08461e569041320 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:38.551677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.673989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beb52d-120f-48b7-88e8-36d02116d0fb None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.693147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.724492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.725745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.726224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.726715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.728193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:38.728734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb74d-49d6-4cf6-9cf6-c44518c352bd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.730159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:38.732110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 80/158] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:38.752069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.774436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.774436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.774436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.774436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.775116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:38.775116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:38.775116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:38.788989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 79/159] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:38.790228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:38.909227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:38.938001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7557263-07a4-4e2c-8034-0a16d327e794 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.956007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d0d-c6f2-4b48-a10f-c76788c3a52e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:38.990284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:38.991199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:38.991481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:38.991758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/users/b905898b30ca452ea08461e569041320/roles/ecb30c413fa448e98eea82a33e1077d9` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:38.993746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, user_id=b905898b30ca452ea08461e569041320, role_id=ecb30c413fa448e98eea82a33e1077d9)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:38.995226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22539f-7bee-4e2c-948b-ccbd13ac7aaf None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:39.012757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:39.016649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.016649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.016649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] PATH_INFO: `/v3/users/90db34a522d24d0a8b320230ceed48a6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.016649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] RBAC: Authorizing `identity:get_user(user_id=90db34a522d24d0a8b320230ceed48a6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:39.017609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:39.019518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 80/160] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:38 2022] GET /identity/v3/users/90db34a522d24d0a8b320230ceed48a6 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:39.027178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:39.088981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 81/161] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:38 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/users/b905898b30ca452ea08461e569041320/roles/ecb30c413fa448e98eea82a33e1077d9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:00:39.108050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b242f9-a1fc-45f1-894d-9a50998181b6 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.108458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b242f9-a1fc-45f1-894d-9a50998181b6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.108772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b242f9-a1fc-45f1-894d-9a50998181b6 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.110325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 82/162] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:39.120915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.121119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.121335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.159928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:39.161218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:39.221241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129953-6c84-4f50-b2f1-a6e64a86f76f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:39.225674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:39.271208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 83/163] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:39.311636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:39.319365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:39.320045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.320332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.320609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.352708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:39.494099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:39.495548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a427ca1-573d-4ea0-ba57-0f940f65a09f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:39.522302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9ae2-db3e-48bb-ab84-a71a983f436c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:39.593163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:39.593999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.594290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.594594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.620670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8395a88a-4fd7-486e-a54b-5134f952e5c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:39.635297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:39.641101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:39.641889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:39.646808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 84/164] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:39.648295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aa32-2310-4226-bcd9-e62a6c76f01e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.648671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aa32-2310-4226-bcd9-e62a6c76f01e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.648955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aa32-2310-4226-bcd9-e62a6c76f01e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.650541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 85/165] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:39.651057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518aa32-2310-4226-bcd9-e62a6c76f01e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:39.712399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 81/166] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:39.713786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.714081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.714380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.732394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:39.743442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:39.749063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:39.829674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:39.841124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518aa32-2310-4226-bcd9-e62a6c76f01e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:39.897855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:39.899276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:39.899570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:39.899852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:39.900617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:39.900929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:39.902378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:39.909380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 82/167] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:39.910578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:39.924035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 86/168] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:39.930122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:40.128156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:40.136309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526619f-53fd-43de-90b0-f64a158bba38 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.150228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17bbe5-566a-433e-8fe4-f7869dec19b4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.217397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.218396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.218710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.218992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.220250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:40.221817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:40.222389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.223841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.224138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.224322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 87/169] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:39 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:40.224780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.225066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:40.231210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:40.232890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:40.234871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 83/170] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:39 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:40.235495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:40.327248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:40.410064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ad57-5b52-4633-a8e8-4da10de6b958 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.453004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79edc0-5348-465f-93a8-d4161ca3bb39 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.454153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.454990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.455273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.455549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.475802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:40.483624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:40.484510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:40.485319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 88/171] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:40.490438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:40.519890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:40.541900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.542593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.542880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.543153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.646328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:40.648405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091ff7-7210-4e88-81cb-ae40fc9e343c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:40.654245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee586-74fa-4fd4-9db1-abb8059e1774 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.690204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.691147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.691257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.691461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.693241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=bff283621e36422286533f104dc729c2, user.id=90db34a522d24d0a8b320230ceed48a6) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:40.693626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:40.695245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8b4bc-f7f7-4da3-8acf-e6a5fbcec033 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:40.701689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 89/172] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:40 2022] GET /identity/v3/role_assignments?user.id=90db34a522d24d0a8b320230ceed48a6&scope.project.id=bff283621e36422286533f104dc729c2&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:40.703114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf230-1706-47ea-8da4-3f3fd58342a0 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.703507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf230-1706-47ea-8da4-3f3fd58342a0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.703887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf230-1706-47ea-8da4-3f3fd58342a0 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.704930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:40.705684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 90/173] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:40.706447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf230-1706-47ea-8da4-3f3fd58342a0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:40.799407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 84/174] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:40.800727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35b98-63c0-4b03-aa4b-83eb24316c84 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.801015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35b98-63c0-4b03-aa4b-83eb24316c84 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.801294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35b98-63c0-4b03-aa4b-83eb24316c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.835543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-eaf35b98-63c0-4b03-aa4b-83eb24316c84 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:40.836500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf230-1706-47ea-8da4-3f3fd58342a0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:40.836903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eaf35b98-63c0-4b03-aa4b-83eb24316c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:40.849357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:40.880906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:40.881596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:40.881940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:40.882695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:40.883476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:40.883793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:40.885202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:40.894834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 91/175] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:40.896261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.021467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79a25-dae6-4b3a-ba6d-650940b9c6de None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.059479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.060394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.060688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.060970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.062183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.063674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.065392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 92/176] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:40 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:41.066170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.073012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 85/177] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:41.074653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e9d0-b5d8-49a1-8624-fe2b4c500c4c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.075148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e9d0-b5d8-49a1-8624-fe2b4c500c4c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.075651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e9d0-b5d8-49a1-8624-fe2b4c500c4c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.077361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 86/178] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:41.078276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e9d0-b5d8-49a1-8624-fe2b4c500c4c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.099366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.191582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.217826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ce90-9c60-4c6c-9e18-82b5909c9a71 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.232263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e9d0-b5d8-49a1-8624-fe2b4c500c4c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.253664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.255195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.255513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.255799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] PATH_INFO: `/v3/users/f040341105664752ba9be38ec7dad1bd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.257003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] RBAC: Authorizing `identity:get_user(user_id=f040341105664752ba9be38ec7dad1bd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.258495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd50a68-62f1-4503-8478-8280caf9048d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.264515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 93/179] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/users/f040341105664752ba9be38ec7dad1bd => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:41.264515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a659-26b5-45dc-bb12-7e87221f3c86 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.264515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a659-26b5-45dc-bb12-7e87221f3c86 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.264515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a659-26b5-45dc-bb12-7e87221f3c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.278210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.278826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.279106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.279509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.280344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=bff283621e36422286533f104dc729c2, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:41.280655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.280958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f349a659-26b5-45dc-bb12-7e87221f3c86 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:41.282101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.282195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f349a659-26b5-45dc-bb12-7e87221f3c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:41.294442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 87/180] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=bff283621e36422286533f104dc729c2&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:41.294442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.389183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 94/181] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:41.390698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0742e-bb4f-4a7d-a5e0-5a5db2681974 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.391063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0742e-bb4f-4a7d-a5e0-5a5db2681974 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.391429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0742e-bb4f-4a7d-a5e0-5a5db2681974 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.393637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 95/182] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:41.394346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0742e-bb4f-4a7d-a5e0-5a5db2681974 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.405322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ecda-dfdf-41b6-a13c-9a4d4b87feb4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.416956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.442810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.444028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.444364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.444643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.446875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.459928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-39ad96a4-6334-4e77-accf-1ed77786ace2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:41.468215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:41.469136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:41.469924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:41.474687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 88/183] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:41.476247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.476539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.476815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.496366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:41.497638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:41.514618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0742e-bb4f-4a7d-a5e0-5a5db2681974 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.555745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.556355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.556642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.556917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.587441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 89/184] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:41.588619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.643321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.644799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.670153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.711817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a361-82e8-4a4f-b1de-6c507cc3477a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.742201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.755130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.760211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 96/185] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:41.760352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.760352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.760352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.760592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.774351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:41.785662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:41.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:41.788614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 90/186] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:41.791269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.866459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c122-a607-462a-932b-453bc66451e4 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.884392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.897379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe083a-3684-4eae-aceb-6b9e951ff0fe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:41.912178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.912982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.913265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.913541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.914291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:41.914630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.916289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.931200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 97/187] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:41.931200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.937506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:41.938335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:41.938766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:41.939051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:41.940228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:41.941695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:41.943497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 91/188] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:41.944275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:41.997625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.044002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87501901-842f-477b-8d33-ee8bb1622ba6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.049331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5963-f36b-4a9e-907c-04a2b4183013 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.083224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.084500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.084990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.085534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] PATH_INFO: `/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.086957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.087335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] RBAC: Authorizing `identity:get_project(project_id=6abb7bd12bde4b0cb6bf020de89f9e22)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.087657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.087946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.088231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.089001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:42.089316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.090039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.090769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.092315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 98/189] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/projects/6abb7bd12bde4b0cb6bf020de89f9e22 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:42.093308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.107416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 92/190] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:42.108545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.154592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.210643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa559f8-eb32-4455-81d0-5482d3361965 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.217352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33faa-a236-4ae1-bed2-560d74c4a12d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.233277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.249525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.250404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.250712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.250989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.255841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.256520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.256800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.257070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.257768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.259297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.267409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.268926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.270874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 99/191] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:42.271640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.354057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 93/192] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:42 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:42.354948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.374710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d516e0-4c30-4707-bbbb-663b93289cc7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.383068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.413371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.414288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.414757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.415188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.416169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=6abb7bd12bde4b0cb6bf020de89f9e22, user.id=f040341105664752ba9be38ec7dad1bd) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:42.416493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.417995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd19db3-5c50-4ada-af26-ec253924c5e6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.427264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 100/193] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/role_assignments?user.id=f040341105664752ba9be38ec7dad1bd&scope.project.id=6abb7bd12bde4b0cb6bf020de89f9e22&role.id=239334dd0e7f463ea1f77dce601caeff => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:42.429280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5076b-a895-4d46-b0e5-6bae30565440 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.432737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5076b-a895-4d46-b0e5-6bae30565440 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.432737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5076b-a895-4d46-b0e5-6bae30565440 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.432737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 101/194] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:42.432737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5076b-a895-4d46-b0e5-6bae30565440 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.526480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f320-87c5-45bc-a4a9-2df8b9ac8c52 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.570662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.571557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.571842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.572114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.573361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.574651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5076b-a895-4d46-b0e5-6bae30565440 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.574881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad52946-bbf2-43e6-ad0e-7e315ed04d72 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.576983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 94/195] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:42.578623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782610-b032-4df5-8f91-429861039984 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.578826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782610-b032-4df5-8f91-429861039984 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.579075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782610-b032-4df5-8f91-429861039984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.599635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-55782610-b032-4df5-8f91-429861039984 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:42.600890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-55782610-b032-4df5-8f91-429861039984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:42.625891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.626599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.626887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.627168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.641937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.684494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.685056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 95/196] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:42.685890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782610-b032-4df5-8f91-429861039984 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.744462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.745950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:42.821360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782610-b032-4df5-8f91-429861039984 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:42.873111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 102/197] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:42.873111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:42.875948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:42.876622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:42.876907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:42.877181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:42.927984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.972858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:42.977060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:42.979269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.012160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b2d3-afe5-4122-96ad-78b66756249f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.061654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.062846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.063339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.063822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.079317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:43.091448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:43.092377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:43.093736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:43.094353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 96/198] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:43.094353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.096371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 103/199] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:43.098934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.212548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283f70-997e-426c-9e49-c3ba32949eea None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.231834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a75f-4280-4602-afe5-5851d9d00c73 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.242857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:43.248599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.249631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.249970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.250250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.252252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.254250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.257478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 97/200] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:43.263554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.278115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:43.287465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.289073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.289870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.290325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.292401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.294580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.297263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 104/201] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:43.299103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.398761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a65a-d1fe-48cf-91a7-5b3840a77d99 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.415931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074677-f71c-4ce5-8227-3b1da6f9f731 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.449105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.450596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.451202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.451798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.452994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:43.453487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.453589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.454377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.454762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.455111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.455804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.456250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1085c27cdcf74eaeaee577b144be3f1a) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:43.456648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.458185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.459141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:43.470443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 105/202] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/role_assignments?user.id=1085c27cdcf74eaeaee577b144be3f1a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:43.470443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.485595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 98/203] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:43.487285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.632214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:43.635352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bbd71-4f98-48c2-b28a-bbbfd7939aeb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.680484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.681386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.683179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.683179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] PATH_INFO: `/v3/users/b905898b30ca452ea08461e569041320` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.685814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] RBAC: Authorizing `identity:get_user(user_id=b905898b30ca452ea08461e569041320)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.690579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.693329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 99/204] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/users/b905898b30ca452ea08461e569041320 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:43.699233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:43.707937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ab1ab-4370-4f4a-9dc3-067bfa33ccfe None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.763219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.763817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.764109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.764388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.765228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1085c27cdcf74eaeaee577b144be3f1a) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:43.765541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.767043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:43.773595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 106/205] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/role_assignments?user.id=1085c27cdcf74eaeaee577b144be3f1a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:43.786909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:43.829323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f688d9-fea9-44e1-bcd9-94e16a5f0856 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:43.874360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:43.875141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:43.875422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:43.875697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:43.965485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:43.967032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:44.054137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:44.097892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 100/206] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:44.099647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:44.227212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a739a-8e01-4799-8610-53bcc1d4e603 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:44.271863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:44.284370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:44.287273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:44.287792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:44.288272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:44.289765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:44.291495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556094f2-2e88-4aad-8484-f1459cf73217 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:44.293433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 107/207] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:44 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:44.299356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:44.413309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191664-ca34-481b-befb-4d07e6320bf0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:44.450695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:44.451705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:44.452210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:44.452700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:44.453746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, scope.project.id=bff283621e36422286533f104dc729c2, user.id=b905898b30ca452ea08461e569041320) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:44.454257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:44.455916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c4a6-e10d-4c2b-bbb6-2c5f895d8f70 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:44.462917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 101/208] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:44 2022] GET /identity/v3/role_assignments?user.id=b905898b30ca452ea08461e569041320&scope.project.id=bff283621e36422286533f104dc729c2&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:45.065725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ada9-eba5-4be8-9949-bca180ab6e4a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.066449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ada9-eba5-4be8-9949-bca180ab6e4a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.067485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ada9-eba5-4be8-9949-bca180ab6e4a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.069388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 108/209] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:45.074574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c696-259b-4fda-8505-33602ad51162 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.075026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c696-259b-4fda-8505-33602ad51162 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.075211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c696-259b-4fda-8505-33602ad51162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.096339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3ff5c696-259b-4fda-8505-33602ad51162 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:45.097540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3ff5c696-259b-4fda-8505-33602ad51162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:45.125527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:45.174947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 102/210] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:45.203078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28ada9-eba5-4be8-9949-bca180ab6e4a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:45.226004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c08b54-4af3-4e4d-8bd5-132d2f3e48da None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.226004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c08b54-4af3-4e4d-8bd5-132d2f3e48da None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.226004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c08b54-4af3-4e4d-8bd5-132d2f3e48da None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.226004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 103/211] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:45.231359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.231504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.231693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.254083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:45.255544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:45.357942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28ada9-eba5-4be8-9949-bca180ab6e4a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:45.373187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 104/212] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:45.420877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:45.429637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:45.430387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.430691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.430986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.434043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:45.435559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:45.437536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 109/213] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:45.444084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:45.506774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:45.546729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e2ec-0dea-44fa-8ff7-21da154057fc None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:45.565394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a8ffa-3b3d-4339-b17c-75a0814dbd12 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:45.574832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:45.585495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:45.586163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.587319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.587761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.595575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:45.595575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:45.606445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:45.607397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.607805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.608128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.621051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:45.629328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:45.630282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:45.631114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:45.631771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 105/214] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:45.643795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:45.711977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 110/215] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:45 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:00:45.844156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19a73-20ac-47ff-a0e6-d26b9202596b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:45.884692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:45.885828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:45.886309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:45.887102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:45.888063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:45.888571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:45.890191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:45.903679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 106/216] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:45.909710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.028068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c617-7de9-40cf-b520-283b5def26c3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.046182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.064449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.067131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.067131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.067131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] PATH_INFO: `/v3/users/1a80550507a44244a92aef2082ff127a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.080504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] RBAC: Authorizing `identity:get_user(user_id=1a80550507a44244a92aef2082ff127a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.082043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0727b47-62e9-48ed-991d-e037c8e80b6f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.084610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 111/217] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:45 2022] GET /identity/v3/users/1a80550507a44244a92aef2082ff127a => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:46.090200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.108939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.128764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212adcc-70f6-47b5-a521-fc40c036860b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.129049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212adcc-70f6-47b5-a521-fc40c036860b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.129335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212adcc-70f6-47b5-a521-fc40c036860b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.131193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 112/218] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:46.137088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055afe5-5422-49a6-98b3-519347504297 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.137382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055afe5-5422-49a6-98b3-519347504297 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.137665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055afe5-5422-49a6-98b3-519347504297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.162215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7055afe5-5422-49a6-98b3-519347504297 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:46.162862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7055afe5-5422-49a6-98b3-519347504297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:46.217274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34c17-1ea8-4e14-ba01-60f30d41e83e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.254331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.254922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 113/219] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:46.256024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.256311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.256588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.279846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055afe5-5422-49a6-98b3-519347504297 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.351490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.353946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.372065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.404059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055afe5-5422-49a6-98b3-519347504297 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.414962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.452997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.454436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.455159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.455746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.473307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-e9be668f-58a6-404a-af35-c6419def05a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:46.481769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:46.482727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:46.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 114/220] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:46.484806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0c13-769d-4972-96bf-1f6685908f36 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.485088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0c13-769d-4972-96bf-1f6685908f36 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.485342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa0c13-769d-4972-96bf-1f6685908f36 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.485550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 107/221] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:46.490475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 115/222] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:46.495331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa0c13-769d-4972-96bf-1f6685908f36 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.495749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.603474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa0c13-769d-4972-96bf-1f6685908f36 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.609394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927535d1-88ef-493e-8b6e-5f719f9a512e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.623679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.641063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.641825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.642182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.642491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.643345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:46.643713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.645861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.648236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.649317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.649752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.650176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.651704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.653309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a78d1-0682-4ebc-9fec-6f90495b85ad None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.655746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 108/223] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:46.657241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.657684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.658129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.661532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 116/224] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:46.669106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.691021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:46.693495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.694292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:46.769689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 109/225] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:46.770891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359548c-4e82-420e-8b42-bb829ee13afb None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.771234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.808205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.808969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.809255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.809536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.810930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1a80550507a44244a92aef2082ff127a) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:46.810930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.812221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.818049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 117/226] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/role_assignments?user.id=1a80550507a44244a92aef2082ff127a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=239334dd0e7f463ea1f77dce601caeff => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:46.823126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:46.887081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e265-c98a-4040-b73a-411c2568a06f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:46.905973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:46.930528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:46.931817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:46.932309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:46.932790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:46.934564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:46.936441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:46.938494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 110/227] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:46.947917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.042850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.062146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc6e9b-4960-446e-b306-c2c029732e7d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.110515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.111346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.111633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.111911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.130889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:47.148777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:47.149689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:47.150556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:47.155478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 118/228] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:47.158063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.168355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f895c-60f5-498f-bc48-d253baec3877 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.212997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.213889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.214195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.214905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.216469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:47.218614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:47.221052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 111/229] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:46 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:47.230439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.312470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.365082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02a39-4140-4bda-a294-aa271036d7d8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.403165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.404190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.405112 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.405589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.406566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:47.407108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:47.408563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d748f-71ac-4ffd-a5a8-f5c945025d73 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.408917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:47.420224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 119/230] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:47.426435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.445264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.476500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.477496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.477675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.478022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1085c27cdcf74eaeaee577b144be3f1a/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.480018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, user_id=1085c27cdcf74eaeaee577b144be3f1a, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:47.481470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:47.544437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f916293-df41-4842-85ed-29e4a9d77f5f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.565755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 112/231] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:47 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1085c27cdcf74eaeaee577b144be3f1a/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:00:47.594091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.595587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.596206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.596661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.599452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:47.601183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:47.603417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 120/232] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:47 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:47.609513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.751164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae5cc-8ed5-4ec2-ad7e-c66bc975761e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:47.765884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.804920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:47.806102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:47.806615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:47.807067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:47.810931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:47.812635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468121e8-be0d-4071-8dfc-c989e428adf6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:47.814662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 113/233] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:47 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:47.820755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:47.929767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.956547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e90ca-cc99-4413-81c7-7da01ad31625 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:48.002951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:48.003775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.004066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.004869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1085c27cdcf74eaeaee577b144be3f1a/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.011241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, user_id=1085c27cdcf74eaeaee577b144be3f1a, role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:48.012983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6000c-d0e8-4d01-8125-dc9cfcae2669 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:48.121378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 121/234] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:47 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1085c27cdcf74eaeaee577b144be3f1a/roles/018279cf41c14fa5b5d2a962378262e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:48.584572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79b52-5c0f-4faa-b775-788ef06685ea None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.585084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79b52-5c0f-4faa-b775-788ef06685ea None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.585160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79b52-5c0f-4faa-b775-788ef06685ea None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.586531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 114/235] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:48.592021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.592419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.592586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.615319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:48.616637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:48.625146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df0a2-051c-4946-b89f-34e58b5b6fad None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.625518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df0a2-051c-4946-b89f-34e58b5b6fad None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.625801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5df0a2-051c-4946-b89f-34e58b5b6fad None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.627481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 115/236] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:48.633557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.633845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.634123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.670820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:48.672148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:48.715414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 122/237] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:48.740475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:48.816895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 116/238] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:48.817872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:48.849127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833de3-1032-40f0-9d9b-eb86efc7fdfe None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:48.860470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:48.906164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:48.907499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:48.907874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:48.908238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:48.932526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:48.949544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:48.950727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:48.951794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 123/239] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:48.959310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.048053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adc4b9-bd41-45f7-b6cb-6c26cb2e327d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.058781 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.123931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.124660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.124942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.125216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.130642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:49.132200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:49.134253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 117/240] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:49.139847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.143275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e15d4c-73b1-42fa-9926-8dc4dd583a3b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.195138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.203667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.204431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.210580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.210580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.210580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:49.210580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:49.210580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:49.225919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 124/241] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:49.232957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.245280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613de1c-0a44-48af-b112-3c3fa69753f5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.287601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.288281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.288568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.288844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.289573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:49.291066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5508be-a462-4d32-b896-0880423c28fb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:49.394202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 118/242] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:49 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:49.410129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989cd50-eb17-4a79-aac1-230081b64d24 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.446720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694951-44cb-4238-a1d5-a2d71f15e07e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.447061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694951-44cb-4238-a1d5-a2d71f15e07e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.447353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694951-44cb-4238-a1d5-a2d71f15e07e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.448848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 119/243] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:49.454387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.454741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.455032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.481622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:49.482912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:49.487881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.488826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.489116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.489442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] PATH_INFO: `/v3/users/bec4c76c6eac4f60a23536c952c1a474` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.524290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] RBAC: Authorizing `identity:get_user(user_id=bec4c76c6eac4f60a23536c952c1a474)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:49.525793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:49.532014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 125/244] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:49 2022] GET /identity/v3/users/bec4c76c6eac4f60a23536c952c1a474 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:49.536694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.539174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.632798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 120/245] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:49.637152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.657982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.693114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e56aa-d437-43c4-b071-a7669ae648b0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.731145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.732071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.732497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.732918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.773669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c817d8-194f-4a6e-991d-64ceef133e73 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:49.808703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:49.810497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:49.820601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:49.821423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:49.821710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:49.821988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:49.833892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:49.843898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:49.844818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:49.845695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 121/246] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:49.855676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:49.867255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.879557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.918759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 126/247] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:00:49.931875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.006078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba792b-dfec-422d-bf1d-5af6cbb02e07 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.050884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8efc2-2437-4495-9550-89e7af59582b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.055539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.056430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.056863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.057285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.058220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:50.058721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.060284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.071041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 122/248] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:50.078402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.097180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.098062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.098377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.098687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.103197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.105684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.107844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 127/249] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:49 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:50.119420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.146297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:50.201381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:50.224988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c72a-9a5a-4a4f-aeda-db92d0caf459 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.271975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e86d-ac6b-4cdc-974b-82bee6dce61d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.273364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.274425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.276330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.276763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] PATH_INFO: `/v3/users/1a80550507a44244a92aef2082ff127a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.278161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] RBAC: Authorizing `identity:get_user(user_id=1a80550507a44244a92aef2082ff127a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.280535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.282384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 123/250] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:50 2022] GET /identity/v3/users/1a80550507a44244a92aef2082ff127a => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:50.289355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.347833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.350755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.351195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.352431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.353423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=bec4c76c6eac4f60a23536c952c1a474) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:50.354652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.356431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd3be4-f8ee-4670-9d79-0fda46e53f78 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.367796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 128/251] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:50 2022] GET /identity/v3/role_assignments?user.id=bec4c76c6eac4f60a23536c952c1a474&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:50.439887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a41b05-c9b6-4278-802c-393fe38d7705 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.447472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e034e-1687-4756-ac26-9f57a35fcf01 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.448007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e034e-1687-4756-ac26-9f57a35fcf01 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.448470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e034e-1687-4756-ac26-9f57a35fcf01 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.450131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 129/252] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:50.455853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.456346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.456774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.480980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:50.482672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:50.537044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.538188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.538669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.539091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.540558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.543509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.546798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 124/253] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:50 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:50.556438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.597296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:50.653223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 130/254] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:50.696255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:50.725995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:50.749262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56621b6-b753-461c-816d-4cd31c2a42f0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.792363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.793656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.794214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.794715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1a80550507a44244a92aef2082ff127a/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.797723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, user_id=1a80550507a44244a92aef2082ff127a, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:50.800384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:50.877648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 125/255] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:50 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/1a80550507a44244a92aef2082ff127a/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:50.887412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad132fd9-e6e2-44d1-bd54-55eeb1431053 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:50.940901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:50.941717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:50.942622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:50.942977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:50.959427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-61be66da-36b8-45b5-9634-7e7469c78842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:50.967536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:50.968480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:50.969889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 131/256] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:50.975186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:51.107700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:51.136738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e0a13-de9a-41d1-be0e-d82c03eb70c8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:51.152730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666daa-f8b2-45a5-b28e-476a39dd5336 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.153048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666daa-f8b2-45a5-b28e-476a39dd5336 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.153305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666daa-f8b2-45a5-b28e-476a39dd5336 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.154745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 132/257] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:51.160328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.161151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.161450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.184649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:51.184834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:51.185493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.185776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.185900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:51.186077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.186826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:51.187132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:51.188738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:51.200807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 126/258] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:51.207210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:51.308910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 133/259] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:51.327257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96ef4-f1f9-42cb-9d8e-c9f2ca290642 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:51.356349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:51.370795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:51.371649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:51.372420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.372717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.372997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.375975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:51.377452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:51.379138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 127/260] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:51 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:51.386249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:51.402770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:51.586878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a99508-5210-41d3-b140-55a4901bb53c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:51.603257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3423112-440c-4fb9-a732-11cb68a88984 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:51.670195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:51.671698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.672185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.672660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.689727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:51.690451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.690730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.691000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.697238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:51.706280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:51.707294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:00:51.708237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:51.711260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 134/261] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:00:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:51.719499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:51.837781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:51.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:51.850776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:51.865542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:51.936642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a040-db51-40a0-8b49-f352483b8723 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:51.993284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:51.994837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:51.995334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:51.995817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:51.996823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:51.997333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:51.998995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:52.016567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 135/262] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:00:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:52.023605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:52.054631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 128/263] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:52.060950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:52.273412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca7183-4086-4647-b8bb-02ff5dccd1c1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:52.273583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacaa2-660f-412d-99d4-6619a033013c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:52.285953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:52.336183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:52.337346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:52.338513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.346915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.347550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.349774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:52.351480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:52.355728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 129/264] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:52 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:52.361604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:52.369728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:52.369728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.369728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.369728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] PATH_INFO: `/v3/users/1085c27cdcf74eaeaee577b144be3f1a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.374808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] RBAC: Authorizing `identity:get_user(user_id=1085c27cdcf74eaeaee577b144be3f1a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:52.376307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:52.382429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 136/265] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:52 2022] GET /identity/v3/users/1085c27cdcf74eaeaee577b144be3f1a => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:52.384366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:52.532534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452db89-4b01-4573-a3f9-c9beab94e0ef None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:52.592590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:52.593645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.594229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.597666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dd806-ff67-481f-aaa7-6973503f4bae None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:52.598931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.600200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1085c27cdcf74eaeaee577b144be3f1a) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:52.600780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:52.602484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:52.617584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 130/266] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:52 2022] GET /identity/v3/role_assignments?user.id=1085c27cdcf74eaeaee577b144be3f1a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:52.643185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:52.643868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.644150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.644431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.711045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:52.718854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:52.720329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9593c-f165-4530-b6ea-8836be7a4350 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:52.830404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 137/267] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:52.836842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:52.919289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:52.954716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf94a-5795-40c0-b00a-1748c449036c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.955026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf94a-5795-40c0-b00a-1748c449036c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.955295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf94a-5795-40c0-b00a-1748c449036c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.956681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 138/268] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:00:52.967844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:52.968129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:52.968421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:52.996527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f5d9-5864-4377-a39a-69c344d5132e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.014483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:53.015700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:53.033822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.035080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.035606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.036862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.039518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.041243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.043653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 131/269] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:52 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:53.049181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.160120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366435-f42c-4fd7-91e0-7f3cbea53b1c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.170014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:53.216725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 139/270] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:53.243705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.244383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.244663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.244937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.245773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1085c27cdcf74eaeaee577b144be3f1a) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:53.246088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.247568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc049-e47b-4dcd-96bf-81fb14f2dd53 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.253645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.258294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 132/271] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/role_assignments?user.id=1085c27cdcf74eaeaee577b144be3f1a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:53.307740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:53.383589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc114b-399d-4422-a458-8475bcc64315 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.383904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc114b-399d-4422-a458-8475bcc64315 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.384160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc114b-399d-4422-a458-8475bcc64315 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.385946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 133/272] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:53.397851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.398153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.398426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.412995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262745c-74b3-4381-b15b-3664c9c2123b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.429909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:53.431191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:53.479561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.480715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.481205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.481631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.497419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:53.507639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:53.508767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:53.509639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:53.510555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 140/273] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:53.520945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.533032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 134/274] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:53.561871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.617236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:53.634313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05d9c-384d-4d44-a29c-4fa4040b49df None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.671113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:53.675403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500118-cb05-4a52-b6b6-6187abab1c1c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.678551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.679417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.680026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.680453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.681409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:53.684454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.684454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.692958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 141/275] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:53.698379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.715169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.716117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.716502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.716783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.718142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.719676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.721759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 135/276] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:53.727491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.818229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad69f90-3618-420c-8d80-635b04b35c05 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.845138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd417da-ba83-4b43-9de2-5ccc38542ec4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:53.859160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.860054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.860340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.860619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] PATH_INFO: `/v3/users/eed4c390ac464c01bedfae091c047036` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.877474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] RBAC: Authorizing `identity:get_user(user_id=eed4c390ac464c01bedfae091c047036)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.879987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.881772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:53.882574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:53.882954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:53.883139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 142/277] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/users/eed4c390ac464c01bedfae091c047036 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:53.883234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:53.888200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:53.888200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2f5d-9bbf-4cf9-b1d3-84ae1db3a7f6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:53.889333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:53.894013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:53.994506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578bc8-bd4a-44ef-bab2-f0b1318d0001 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.004842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 136/278] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:00:53 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:00:54.015062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494c1d-bde4-4881-adcb-040fd520a407 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.015145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494c1d-bde4-4881-adcb-040fd520a407 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.015406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494c1d-bde4-4881-adcb-040fd520a407 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.018469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 137/279] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:54.018469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df04c3-87e0-4781-af44-4f65a16e4c34 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.018469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df04c3-87e0-4781-af44-4f65a16e4c34 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.018803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df04c3-87e0-4781-af44-4f65a16e4c34 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.020282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 138/280] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:54.024707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.027439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.027439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.039223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.039915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.040204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.040484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.041334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, user.id=eed4c390ac464c01bedfae091c047036, scope.system=all) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:54.041654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:54.043220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e330c3-fe32-4963-9c90-ef33132899ff None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:54.046011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:54.047526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:54.049361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 143/281] 10.222.0.74 () {56 vars in 1308 bytes} [Fri May 27 15:00:53 2022] GET /identity/v3/role_assignments?user.id=eed4c390ac464c01bedfae091c047036&scope.system=all&role.id=239334dd0e7f463ea1f77dce601caeff => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:54.049361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.049361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.049361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.075748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.080849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:54.082868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:54.143912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 139/282] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:54.171420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.187080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.194523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 144/283] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:54.218261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.308197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05786520-f62e-450c-a4ad-e650ade0af4c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.349158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d631351-f272-4f1e-9a2f-35bab122435a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.354023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.354864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.355145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.355419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.369170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:54.377351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:54.378266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:54.379163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 140/284] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:54.386639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.397560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.398378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.398747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.399027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.408361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.415509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:54.424809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:54.425761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:00:54.427432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 145/285] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:00:54.434850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.509198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.536329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b2a30-a070-42b5-9d9e-30afbcafb24e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.561986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250a4e-416f-48c4-b15d-fcb28c24d6ac None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.579838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.581128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.581558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.581975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.583045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:54.583516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:54.585595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:54.597379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 141/286] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:54.603199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.604019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.604450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.604825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.605738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:54.606154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:54.607733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:54.611185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.625765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 146/287] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:54.631432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.693209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.717306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68939-b903-45e1-be67-b68ed419979b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.753962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.755403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.755786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.756161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] PATH_INFO: `/v3/users/bec4c76c6eac4f60a23536c952c1a474` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.757273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71c75-ca1a-4c78-8311-724a56ec5bca None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.757662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] RBAC: Authorizing `identity:get_user(user_id=bec4c76c6eac4f60a23536c952c1a474)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:54.759278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:54.761282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 142/288] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/users/bec4c76c6eac4f60a23536c952c1a474 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:54.769186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.787223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:54.819066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:54.819915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:54.820210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:54.820495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] PATH_INFO: `/v3/users/1a80550507a44244a92aef2082ff127a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:54.823072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] RBAC: Authorizing `identity:get_user(user_id=1a80550507a44244a92aef2082ff127a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:54.824608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:54.830858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 147/289] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/users/1a80550507a44244a92aef2082ff127a => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:00:54.833497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:54.907571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61917808-feb9-4e91-bfca-7aa74f5b711e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:54.974505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe259df-438f-492f-ae83-c65dfe1390b6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:55.012525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:55.013189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:55.013483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:55.013771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:55.027196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:55.028101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:55.028396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:55.028681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:55.031455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:55.036752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:55.040411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 143/290] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:55.047045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:55.096711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:55.102767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:55.114990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:55.116693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:55.228181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 148/291] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:00:55.235618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:55.337946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57a51-592e-4559-b380-4ba74ca9851c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:55.380621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:55.381454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:55.381739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:55.382016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/bec4c76c6eac4f60a23536c952c1a474/roles/ecb30c413fa448e98eea82a33e1077d9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:55.384105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, user_id=bec4c76c6eac4f60a23536c952c1a474, role_id=ecb30c413fa448e98eea82a33e1077d9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:55.385580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9df1d-eeb6-430a-b0bd-7f789480e82a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:55.416485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:55.426749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6786b2-a7c4-41a2-9113-b4ecb52374a2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:55.461000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:55.461871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:55.462154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:55.462457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:55.463644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:55.465082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:55.467091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 149/292] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:55 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:55.472933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:55.494965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 144/293] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:00:55 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/users/bec4c76c6eac4f60a23536c952c1a474/roles/ecb30c413fa448e98eea82a33e1077d9 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:55.612229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f452da-ef08-47c5-87ba-e64a4534566f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:55.661822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:55.662524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:55.662811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:55.663087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:55.663928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=1a80550507a44244a92aef2082ff127a) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:55.664235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:55.665793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7ee9c-c086-4218-a437-1bef66003052 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:55.672901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 150/294] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:55 2022] GET /identity/v3/role_assignments?user.id=1a80550507a44244a92aef2082ff127a&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=239334dd0e7f463ea1f77dce601caeff => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:56.613254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a8b9-a43b-4dde-9993-40e5f201fd8a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.614303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a8b9-a43b-4dde-9993-40e5f201fd8a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.614590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a8b9-a43b-4dde-9993-40e5f201fd8a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.616396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 145/295] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:56.621873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7674-f60f-4af9-9ad3-d9db706152e7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.622374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7674-f60f-4af9-9ad3-d9db706152e7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.622582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7674-f60f-4af9-9ad3-d9db706152e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.640138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4e4b7674-f60f-4af9-9ad3-d9db706152e7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:56.641345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4e4b7674-f60f-4af9-9ad3-d9db706152e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:56.658844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:56.716541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 151/296] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:56.738144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a8b9-a43b-4dde-9993-40e5f201fd8a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:56.741246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d386d-6cb6-4853-9c78-bd5a1889fb82 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.741536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d386d-6cb6-4853-9c78-bd5a1889fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.741815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d386d-6cb6-4853-9c78-bd5a1889fb82 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.743451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 152/297] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:56.751118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18529c-8c37-4bb0-acee-48280015b54a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.751404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18529c-8c37-4bb0-acee-48280015b54a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.751679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18529c-8c37-4bb0-acee-48280015b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.774359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-9d18529c-8c37-4bb0-acee-48280015b54a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:56.776009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9d18529c-8c37-4bb0-acee-48280015b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:56.834823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:56.855437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 153/298] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:56.856814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992a8b-d844-4615-9aca-2360b16b3de5 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.857103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992a8b-d844-4615-9aca-2360b16b3de5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.857383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992a8b-d844-4615-9aca-2360b16b3de5 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.865596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 154/299] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:56.865596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.865596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.865596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.877141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a8b9-a43b-4dde-9993-40e5f201fd8a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:56.881527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:56.882862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:56.919764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:56.920567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:56.920850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:56.921138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:56.932288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:56.940130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:56.941042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 146/300] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:56.943238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:56.960028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 155/301] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:00:56.960028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:56.983945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.051704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb36d6-f5f6-4159-87ab-fa53e2ef555d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.078174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41500-893a-4a31-bc91-aa402f02bd27 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.082001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.087870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.088958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.089384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.091856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.101028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:57.109482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:57.110352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:57.111288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:57.118071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.118488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 147/302] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:57.118704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.118995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.119283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.119896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.120096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:57.120323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.121745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.134459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 156/303] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.134459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.203764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.230529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4091c-5b09-4cdd-9f3d-5e740da5630a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.234563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2e60-ab5b-4720-afc6-bf78532dd604 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.267994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.268787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.269075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.269358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.270813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.271097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.271487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.271777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.272058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.272536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.272817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:57.273128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.274313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 148/304] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.274945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.278983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.292520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 157/305] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.292520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.339710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.381556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caa1e5-9165-4511-9228-372a36f521d8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.404776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a4cf-d996-46ba-9e08-2e58315de482 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.417509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.418388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.418702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.418972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] PATH_INFO: `/v3/users/eed4c390ac464c01bedfae091c047036` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.420164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] RBAC: Authorizing `identity:get_user(user_id=eed4c390ac464c01bedfae091c047036)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.421613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.426767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 149/306] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:57 2022] GET /identity/v3/users/eed4c390ac464c01bedfae091c047036 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.426767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.449560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.450233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.450553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.450833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] PATH_INFO: `/v3/groups` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.451522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.452964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.456116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.536020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cc7ff-743b-477e-bf0c-aaed0a48e12c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.540602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 158/307] 10.222.0.74 () {60 vars in 1134 bytes} [Fri May 27 15:00:57 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:00:57.552288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.574129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:57.584518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.585835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.586333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.586889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] PATH_INFO: `/v3/users/880ad43a54ce42829360d00f30febef8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.604449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] RBAC: Authorizing `identity:get_user(user_id=880ad43a54ce42829360d00f30febef8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.606438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.608630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 150/308] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:57 2022] GET /identity/v3/users/880ad43a54ce42829360d00f30febef8 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.615178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:57.679165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd3c8-9a72-4483-8c8c-fde0dc256349 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.721041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.721931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.722212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.722530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] PATH_INFO: `/v3/system/users/eed4c390ac464c01bedfae091c047036/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.724706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eed4c390ac464c01bedfae091c047036, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.726108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe15f-d0a5-435a-88e2-8ed05d574fdc None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.742385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917022-1f02-48eb-ba37-c5392c9d20c5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:57.788218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:57.788895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.789180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.789458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.790295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, user.id=880ad43a54ce42829360d00f30febef8, scope.system=all) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:57.790652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:57.792145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45759-0b28-481e-b73e-3d9714b9da17 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:57.797753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 151/309] 10.222.0.74 () {56 vars in 1308 bytes} [Fri May 27 15:00:57 2022] GET /identity/v3/role_assignments?user.id=880ad43a54ce42829360d00f30febef8&scope.system=all&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:57.823706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 159/310] 10.222.0.74 () {58 vars in 1334 bytes} [Fri May 27 15:00:57 2022] PUT /identity/v3/system/users/eed4c390ac464c01bedfae091c047036/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:00:57.951509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db989-baf2-40ec-b2dc-80f3e6aa0048 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.951830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db989-baf2-40ec-b2dc-80f3e6aa0048 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.952228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db989-baf2-40ec-b2dc-80f3e6aa0048 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.954132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 152/311] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:57.960380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:57.960793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:57.961142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:57.981016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:57.982295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:58.051868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:58.067598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 160/312] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:00:58.092219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db989-baf2-40ec-b2dc-80f3e6aa0048 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:58.150718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:58.202725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db989-baf2-40ec-b2dc-80f3e6aa0048 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:58.237635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:58.238456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:58.239296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:58.239574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:58.249788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:00:58.257665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:00:58.258576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:00:58.259379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 153/313] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:00:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:00:58.265028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:58.370365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab81fc5-175e-46ed-b0fd-00c634f0ebad None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:58.407282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:58.407962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:58.408253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:58.408534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:58.409284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:58.409600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:58.411309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:58.424637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 161/314] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:00:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:58.427730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:58.533806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e523-6f3c-4ce3-9a28-ec456ea6474c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:58.544736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:58.568909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:58.569788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:58.570069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:58.570339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] PATH_INFO: `/v3/users/bec4c76c6eac4f60a23536c952c1a474` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:58.574428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] RBAC: Authorizing `identity:get_user(user_id=bec4c76c6eac4f60a23536c952c1a474)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:58.574428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:58.574998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 154/315] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:00:58 2022] GET /identity/v3/users/bec4c76c6eac4f60a23536c952c1a474 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:58.580150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:58.631747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:58.683366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005c0c-9199-44dc-a0bc-2fc72e3fac90 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:58.718114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:58.718868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:58.719150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:58.719423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:58.794207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:58.796002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:58.845927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:58.898891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 162/316] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:00:58.904213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:59.012966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa7a8-92d6-47d3-8aa8-9ffbcc034ced None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:59.049520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:59.050312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:59.050621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:59.050896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:59.052600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:59.054045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476ad1-af83-4383-8827-dab9e408da63 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:59.056050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 155/317] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:00:58 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:59.061733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:00:59.168392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65b8a1-709d-4b3f-a01d-34311f209a89 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:00:59.204516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:00:59.205185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:59.205475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:59.205757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:59.206680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6, user.id=bec4c76c6eac4f60a23536c952c1a474) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:00:59.206998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:00:59.208480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63e5e6-9970-4261-9f29-6818c7f7666b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:00:59.214581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 163/318] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:00:59 2022] GET /identity/v3/role_assignments?user.id=bec4c76c6eac4f60a23536c952c1a474&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:00:59.882584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fee4-bb57-4c2d-aaea-3c6434bf2856 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:59.882960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fee4-bb57-4c2d-aaea-3c6434bf2856 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:59.883160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fee4-bb57-4c2d-aaea-3c6434bf2856 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:59.884582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 156/319] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:00:59.889889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939bbd-de33-4b38-bed8-02e7a099a582 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:00:59.890312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939bbd-de33-4b38-bed8-02e7a099a582 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:00:59.890500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939bbd-de33-4b38-bed8-02e7a099a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:00:59.908420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2d939bbd-de33-4b38-bed8-02e7a099a582 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:00:59.909717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2d939bbd-de33-4b38-bed8-02e7a099a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:00:59.921544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:59.986459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 164/320] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:00.008660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5fee4-bb57-4c2d-aaea-3c6434bf2856 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.060646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.115174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5fee4-bb57-4c2d-aaea-3c6434bf2856 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.122489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca096b-bcfc-4e9d-a1ce-981ee6051dd7 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.122788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca096b-bcfc-4e9d-a1ce-981ee6051dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.123078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca096b-bcfc-4e9d-a1ce-981ee6051dd7 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.124459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 165/321] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:01:00.129948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d3ab-ef51-4b81-8718-1434a8fb33c7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.130243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d3ab-ef51-4b81-8718-1434a8fb33c7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.130568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d3ab-ef51-4b81-8718-1434a8fb33c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.148170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-87e3d3ab-ef51-4b81-8718-1434a8fb33c7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:00.149283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-87e3d3ab-ef51-4b81-8718-1434a8fb33c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:00.150639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.151435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.151714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.152004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.153122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.154582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9cc49-791f-490d-a77e-407ec05a3742 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.156189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 157/322] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:00.157347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679feb7-2d45-4571-b822-0965f5aeda38 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.157619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679feb7-2d45-4571-b822-0965f5aeda38 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.157892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679feb7-2d45-4571-b822-0965f5aeda38 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.159138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 158/323] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:00.161751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679feb7-2d45-4571-b822-0965f5aeda38 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.220530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 166/324] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:00.223792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.224157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.224448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.240296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:00.241639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:00.265179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679feb7-2d45-4571-b822-0965f5aeda38 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.279399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.299333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.299988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.300308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.300588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.301804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.303268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.309182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 167/325] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:00.310010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.313023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.397294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 159/326] 10.222.0.74 () {60 vars in 1134 bytes} [Fri May 27 15:01:00 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:00.398491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.407384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460e08-0abe-46ea-8550-e2eaffcee63b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.449346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.450202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.450502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.450791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.463811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:00.472895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:00.473863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:00.474714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:00.475844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 168/327] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:00.481460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.518225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02500-fc33-4f4d-981b-292949db92c1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.555118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.556224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.556976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.557260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.557536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.569930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:00.578067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:00.579213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:00.580151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 160/328] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:00.585415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.607271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c70a7-0923-4c64-9cf3-e1ea305b8664 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.626939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.651858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.652526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.652809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.653085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.653825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:00.654132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.655599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.665077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 169/329] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:00.671692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.714732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6596d06-25dd-430e-a934-9db3f864ace8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.758445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.759532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.759925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.760215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.760983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:00.761295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.763009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.774355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 161/330] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:00.779908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.796939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96516b31-8718-4f1a-a56b-4677f4e81ec2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.827903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.840436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.841353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.847022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.847022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] PATH_INFO: `/v3/users/eed4c390ac464c01bedfae091c047036` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.847022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] RBAC: Authorizing `identity:get_user(user_id=eed4c390ac464c01bedfae091c047036)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.847022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.849197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 170/331] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/users/eed4c390ac464c01bedfae091c047036 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:00.855574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.905242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.910959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3830-d626-456d-932f-d2e53c543295 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:00.962966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:00.963854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:00.964132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:00.964403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] PATH_INFO: `/v3/users/880ad43a54ce42829360d00f30febef8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:00.966315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] RBAC: Authorizing `identity:get_user(user_id=880ad43a54ce42829360d00f30febef8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:00.967803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:00.969702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 162/332] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/users/880ad43a54ce42829360d00f30febef8 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:00.976970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:00.993814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1b95-5a04-4da7-ab31-01a0c5d1ae2e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:01.034385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:01.035322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:01.036651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:01.037089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:01.038111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] RBAC: Adding query filter params (role.id=239334dd0e7f463ea1f77dce601caeff, user.id=eed4c390ac464c01bedfae091c047036, scope.system=all) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:01.038600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:01.040198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5502f-9ece-42e1-bf2d-8524869d09a4 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:01.060351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 171/333] 10.222.0.74 () {56 vars in 1308 bytes} [Fri May 27 15:01:00 2022] GET /identity/v3/role_assignments?user.id=eed4c390ac464c01bedfae091c047036&scope.system=all&role.id=239334dd0e7f463ea1f77dce601caeff => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:01.120802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a3b8-d484-442b-8bb1-d8be11f94ddb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:01.161358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:01.162548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:01.162979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:01.163430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] PATH_INFO: `/v3/system/users/880ad43a54ce42829360d00f30febef8/roles/ecb30c413fa448e98eea82a33e1077d9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:01.165193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=880ad43a54ce42829360d00f30febef8, role_id=ecb30c413fa448e98eea82a33e1077d9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:01.166779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b6bf-1485-45b9-a6bd-f3a3ae2791f8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:01.251869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 163/334] 10.222.0.74 () {58 vars in 1334 bytes} [Fri May 27 15:01:00 2022] PUT /identity/v3/system/users/880ad43a54ce42829360d00f30febef8/roles/ecb30c413fa448e98eea82a33e1077d9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:03.359700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b298-77cd-4e83-9d3d-24225a4faee4 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.360217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b298-77cd-4e83-9d3d-24225a4faee4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.360292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b298-77cd-4e83-9d3d-24225a4faee4 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.361872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 172/335] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:03.367745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.368180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.368357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.385783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:03.389142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:03.417494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:03.474474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 164/336] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:03.511777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b298-77cd-4e83-9d3d-24225a4faee4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:03.572307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:03.626766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b298-77cd-4e83-9d3d-24225a4faee4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:03.669273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:03.670094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.670383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.670690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.687622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-37ccaf94-3a21-42f2-b04d-151bef801940 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:03.696700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:03.697617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:03.698675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 173/337] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:03.703732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:03.768893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54565-5260-4e52-8540-76482ca33561 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.769208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54565-5260-4e52-8540-76482ca33561 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.769459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54565-5260-4e52-8540-76482ca33561 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.771757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 174/338] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:03.778380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.778829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.779122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.812052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:03.813186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:03.843204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26800cc-8bec-4cad-b354-303d8346f32e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:03.891369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:03.892685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:03.894619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:03.895270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:03.896620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:03.898444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:03.900364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:03.910003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 165/339] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:03.918315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:03.953465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:03.996965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 175/340] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:04.042560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.065170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94e31-38cb-45ae-8c49-fa743806169d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:04.109974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:04.111120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.111622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.112091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.115109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.198427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73bc3-879f-452d-a575-d1ab171dd2b7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:04.241820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:04.242657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.242944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.243222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.254528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-2b544075-629f-4cc2-95ec-e2f015a39a10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:04.267053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:04.268039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:04.269591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 176/341] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:04.271570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a9cb-0dc7-42f3-a27b-8482895ce20d None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.271756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a9cb-0dc7-42f3-a27b-8482895ce20d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.273558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a9cb-0dc7-42f3-a27b-8482895ce20d None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.273558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 177/342] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:04.277830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209a9cb-0dc7-42f3-a27b-8482895ce20d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.303546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:04.305069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca780-0488-46a4-981d-692d06112f81 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:04.358485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.399378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209a9cb-0dc7-42f3-a27b-8482895ce20d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:04.416245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.447837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:04.448572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.448812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.449204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.449988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:04.450263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:04.451689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a215c-d40b-4533-bee7-e87db6f07cb6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:04.463053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 178/343] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:04.464325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.464615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.464896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.487242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:04.488450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:04.513577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 166/344] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:01:04.515670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3392-2356-4235-92e2-44e7adab51b4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.515961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3392-2356-4235-92e2-44e7adab51b4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.516590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3392-2356-4235-92e2-44e7adab51b4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.518389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 167/345] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:04.519427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3392-2356-4235-92e2-44e7adab51b4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.577818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 179/346] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:04.586765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.655526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3392-2356-4235-92e2-44e7adab51b4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:04.683519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.703859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:04.704506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.705077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.705366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.726090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.735541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac9a21-ea31-4ebb-bdf1-03252c3615b1 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:04.782265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:04.783435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.783721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.784003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.786206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:04.788205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb657-cb0c-4c49-8070-404cfcb9eff6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:04.790732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 180/347] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:04.792069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:04.792472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:04.792752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:04.802033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:04.803684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:04.813480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:04.814779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:04.899772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 181/348] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:04.900578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.961723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 168/349] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:04.963369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:04.994075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.044271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.055525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432074eb-a78d-4fb6-a28a-3b20135a9d27 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.100961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cccc0-a4ad-4da8-b12c-d74aa106d617 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.102074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.102911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.103196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.103469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.119095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7eb9f5a8-1f3c-4061-99a5-3cbd5b384f22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:05.130216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:05.131653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 182/350] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:05.132476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860a56-1aa5-46f7-a626-55a61e25ef57 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.133227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860a56-1aa5-46f7-a626-55a61e25ef57 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.133227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860a56-1aa5-46f7-a626-55a61e25ef57 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.134318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 183/351] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:05.139049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860a56-1aa5-46f7-a626-55a61e25ef57 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.148538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.149424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.149709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.149990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.160280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.161876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.168501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 169/352] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:04 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.168501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.283024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.286788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860a56-1aa5-46f7-a626-55a61e25ef57 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.302462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266d7f-f6c7-450b-a2dd-c2eeae718f12 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.330013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.331089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.331511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.331801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.349701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:05.352978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.354140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.354750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.355386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.359731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-9a34df7f-b6e5-4a1c-b961-8e66048983be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:05.359909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:05.360768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:05.361567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:05.362172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.362239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 184/353] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:05.362239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.362239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.362239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.366477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 170/354] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.367761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.383092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:05.384643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:05.393441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.478097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 185/355] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:05.480005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.507929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9dca-e7e0-401d-bb8d-fb9050d505ba None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.550979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.551964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.552178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.552454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.553309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:05.553616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.555139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.563919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 171/356] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.564652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.583449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.608034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dd52b-8990-498b-85f1-d54bac31410e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.657997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.658765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.659053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.659332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.660165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=bff283621e36422286533f104dc729c2) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:05.661064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.662708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.672703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 186/357] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=bff283621e36422286533f104dc729c2&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.672703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.683322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083b826-d5e1-41d4-a464-d2fd8cf3beb9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.684077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.729997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.731003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.731281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.731561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.732786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.734386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.737312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 172/358] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.738240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.809681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8154d-4414-4cd7-b310-7486c9d64d1a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.855522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.856034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.857003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.857286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.857559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.858316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:05.858651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:05.860037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120c1a-efce-431c-8027-d39f1f0ac32d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:05.870724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 187/359] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:05.873001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cc0bf-b3ee-409f-9654-12e1749ed689 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.873301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cc0bf-b3ee-409f-9654-12e1749ed689 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.873581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cc0bf-b3ee-409f-9654-12e1749ed689 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.874882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 188/360] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:05.878686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815c1c-806d-4309-a155-2a27abbef709 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:05.879272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cc0bf-b3ee-409f-9654-12e1749ed689 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.931767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:05.933489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:05.934116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:05.934660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:05.949528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:05.958363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:05.959323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:05.960123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:05.961241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 173/361] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:05.966483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:05.968827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.012774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cc0bf-b3ee-409f-9654-12e1749ed689 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.061290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.062096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.062378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.062697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] PATH_INFO: `/v3/users/880ad43a54ce42829360d00f30febef8` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.065004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] RBAC: Authorizing `identity:get_user(user_id=880ad43a54ce42829360d00f30febef8)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.066111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.073846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 189/362] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/users/880ad43a54ce42829360d00f30febef8 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:06.073846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.097200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406929c-bc7f-4062-be1c-9f721b87ca34 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.136177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.137201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.137970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.138469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.139496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=bff283621e36422286533f104dc729c2) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:06.140006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.141671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9747f-73cc-4d81-94ac-4598e3b1ad9a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.149033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 174/363] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:05 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=bff283621e36422286533f104dc729c2&role.id=239334dd0e7f463ea1f77dce601caeff => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:06.150767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.151527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.151952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.166521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.172949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:06.180496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:06.225790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbe24b-646c-4555-b37f-f3ebe6e7bf6e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.270120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 175/364] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:06.271517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.287476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.288507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.289003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.289467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.297403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.398946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.401211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.430058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0f86-0cc7-49bf-90a6-fa157d0c376d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.478348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.479197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.479523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.479906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.480672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:06.480984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.482932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.486334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.496808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 176/365] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:06.497722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.552054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 190/366] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:06.552915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.604727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.634205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe59-3a45-42a8-896f-986758feacd8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.677418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.678185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.678560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.678902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.679928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] RBAC: Adding query filter params (role.id=ecb30c413fa448e98eea82a33e1077d9, user.id=880ad43a54ce42829360d00f30febef8, scope.system=all) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:06.680306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.681913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.697715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 177/367] 10.222.0.74 () {56 vars in 1308 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/role_assignments?user.id=880ad43a54ce42829360d00f30febef8&scope.system=all&role.id=ecb30c413fa448e98eea82a33e1077d9 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:06.698870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.706234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77a21-ef7f-426f-a916-9ed01dfa7376 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.759576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.761016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.762060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.762837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.773836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.781814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:06.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:06.793309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:06.794178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 191/368] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:06.797865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:06.841859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62da17-e481-4dc9-810a-8d7d2c14f271 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.884885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.885936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.886462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.887003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.932137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:06.938967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc913b-812c-459b-9128-0931fae8e600 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:06.969311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.971977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.979640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:06.980610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:06.980961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:06.981304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:06.982723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:06.984374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:06.986375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 192/369] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:06.987194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.040581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.092230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 178/370] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:07.093405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.108077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c156-d7ff-442b-8f36-c802a2d6cae9 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.147927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.148698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.149074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.149424 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.150232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:07.150628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.152076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.161030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 193/371] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.163349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.194666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.205682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06467e-01b7-4ca0-b202-96f6ca62c6c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.243667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.244821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.245279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.245751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.247170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.248879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.251035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 179/372] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.252063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.275270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac49683-2d35-4879-b8da-3a6086c2cbee None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.280553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.312223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.313241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.313585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.313931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.315301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.318541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.320221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 194/373] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.321173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.362195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df487b-35ad-4869-9914-914c7ed069b8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.399784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.400778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.401253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.401720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.419694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.427770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335507c9-7c35-4e6c-91e1-ec51ac5de6aa None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.463579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.464087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.464715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.465037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.465930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:07.466306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.467880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.475135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 195/374] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=239334dd0e7f463ea1f77dce601caeff => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.476521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.478837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.480600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.510048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.592961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 180/375] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:07.597694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320509-fb61-4c17-bf03-956b16d6f740 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.599946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.639471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.640414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.640688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.640973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.643873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.645967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.649286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 196/376] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.653402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.715510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.803468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500be71-57a8-4fa5-aeac-34a11f550bf7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.838706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.853344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9ae1-b6ad-4854-9190-955e862f000f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:07.854260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.855673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.856171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.856639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] PATH_INFO: `/v3/projects/96792dba09744fc9ab793949f57108dd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.859010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] RBAC: Authorizing `identity:get_project(project_id=96792dba09744fc9ab793949f57108dd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.860720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.863176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 181/377] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/projects/96792dba09744fc9ab793949f57108dd => generated 344 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.869290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:07.945063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:07.945733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:07.946075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:07.946291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:07.947156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:07.947468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:07.948887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:07.961488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 197/378] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 260 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:07.991162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147008-e1d0-421b-ab5f-5d1b89cbebfa None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:08.030273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:08.031539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.032042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.032509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] PATH_INFO: `/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.039094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] RBAC: Authorizing `identity:get_group(group_id=f4441ab3cab34a09a4d6efe5ad7bb2b9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:08.040909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd40b-fc6d-4376-b919-4baa11da2a0a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:08.043035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 182/379] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:07 2022] GET /identity/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:08.049052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:08.193690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:08.205165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041288-f1f9-4d91-98a0-dfbf1594a67d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:08.251054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:08.251826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.252528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.252808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.253647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] RBAC: Adding query filter params (group.id=f4441ab3cab34a09a4d6efe5ad7bb2b9, role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=96792dba09744fc9ab793949f57108dd) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:08.253959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:08.256613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37ffe-fe5d-42aa-852c-915a4a38a31a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:08.263907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 198/380] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:08 2022] GET /identity/v3/role_assignments?group.id=f4441ab3cab34a09a4d6efe5ad7bb2b9&scope.project.id=96792dba09744fc9ab793949f57108dd&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:08.666998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f109f-f659-4f70-a359-a2e57f0a67cf None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.667711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f109f-f659-4f70-a359-a2e57f0a67cf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.667993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f109f-f659-4f70-a359-a2e57f0a67cf None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.669671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 183/381] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:08.675873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7125a4-8332-4b6f-8fd4-7afb79133a3b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.676629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7125a4-8332-4b6f-8fd4-7afb79133a3b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.676629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7125a4-8332-4b6f-8fd4-7afb79133a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.694077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-eb7125a4-8332-4b6f-8fd4-7afb79133a3b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:08.695956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eb7125a4-8332-4b6f-8fd4-7afb79133a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:08.780078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 199/382] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:08.820986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f109f-f659-4f70-a359-a2e57f0a67cf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:08.891438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616268-0bb1-48b0-b282-97269c29a110 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.891761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616268-0bb1-48b0-b282-97269c29a110 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.892007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616268-0bb1-48b0-b282-97269c29a110 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.893661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 200/383] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:08.902258 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:08.902573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:08.902860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:08.907991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:08.937341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:08.938559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:08.995041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f109f-f659-4f70-a359-a2e57f0a67cf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.062710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.063528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.063811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.064085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.068901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 201/384] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:09.080586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:09.089475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:09.090382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:09.091192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 184/385] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:09.097538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.102372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.123052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:09.273963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac431-c480-4c2c-af40-1553d881dc79 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.292551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5ce07-c5ca-4583-996c-6b9563f17df6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.318655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:09.336700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.337377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.337656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.337933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.338698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:09.339774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:09.341820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:09.354432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 202/386] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:09.359659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.360250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.360914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.361378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.361831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.386879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:09.400663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:09.401565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:09.402367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:09.405034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 185/387] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:09.410337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.503100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:09.525465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42eef-aed6-4269-aefb-22f0ad8d6285 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.562948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.563814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.564096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.564372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.565553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:09.570434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:09.574561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 203/388] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:09.575782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.630571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1675-52a4-42e2-bca9-e93c5700a2d3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.688646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36bbd7-96e5-47b3-9619-edf48fa00f2e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.715995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.717023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.717452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.717859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.718900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:09.719370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:09.720999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:09.728176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.729796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.730156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.730529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.731808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:09.738450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:09.738450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 204/389] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:09.741825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.742462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 186/390] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:09.748235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:09.759467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:09.858149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4092d-d37b-4def-9294-5b2b20e48f89 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.869698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:09.897972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:09.899264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:09.899681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:09.899968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/groups/c4b1e3439a354f86a2a8652105a33041/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:09.902379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, group_id=c4b1e3439a354f86a2a8652105a33041, role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:09.903840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:09.969744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea3403-4f45-4f2e-bcdb-b814d18f5b5c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:09.988831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 205/391] 10.222.0.74 () {58 vars in 1442 bytes} [Fri May 27 15:01:09 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/groups/c4b1e3439a354f86a2a8652105a33041/roles/018279cf41c14fa5b5d2a962378262e8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:10.014657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:10.015576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.015871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.016156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.023533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:10.025132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:10.027373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 187/392] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:09 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:10.032950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:10.130893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:10.164362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d1f85-d8f4-4e7c-8176-fd024e904827 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:10.202187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:10.203108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.203391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.203728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.204979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:10.206464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690fdc5-e6f2-4bba-9c89-944d1a774071 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:10.209280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 206/393] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:10 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:10.214748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:10.292171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3a3c-3310-42d1-8d5b-73d4fc167d46 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.292820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3a3c-3310-42d1-8d5b-73d4fc167d46 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.293306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3a3c-3310-42d1-8d5b-73d4fc167d46 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.295195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 207/394] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:10.300535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.301755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.302349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.323765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:10.325305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:10.325626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf275d-a6aa-4477-9f51-aa980aeea4dc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:10.333544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:10.369248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:10.370532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.371026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.371508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2/groups/c4b1e3439a354f86a2a8652105a33041/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.373814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bff283621e36422286533f104dc729c2, group_id=c4b1e3439a354f86a2a8652105a33041, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:10.376818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:10.431307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 208/395] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:10.454653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:10.479404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 188/396] 10.222.0.74 () {58 vars in 1442 bytes} [Fri May 27 15:01:10 2022] PUT /identity/v3/projects/bff283621e36422286533f104dc729c2/groups/c4b1e3439a354f86a2a8652105a33041/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:10.540898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:10.574527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbd7f9-3043-4a15-8831-dddb0c2679a5 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:10.612688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:10.613616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.614138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.614384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.626969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:10.636419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:10.642322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:10.643165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 209/397] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:10.644298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:10.787177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64eef-de23-426e-9c8f-ebee1a3a91d6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:10.839948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:10.840656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:10.840948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:10.841232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:10.842006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:10.842319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:10.843811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4581-944d-439f-8257-87e1d673b9c6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:10.858867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 189/398] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:10.864960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:10.999451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7bc2-2ed4-4ef1-abda-101da351343d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.016204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078cf71-10cd-4b68-a932-7a48361de5e0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.016727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078cf71-10cd-4b68-a932-7a48361de5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.016727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078cf71-10cd-4b68-a932-7a48361de5e0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.018560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 190/399] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:11.026267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839c98-4834-4df9-8a85-ee4d6c5b297d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.026856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839c98-4834-4df9-8a85-ee4d6c5b297d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.027333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839c98-4834-4df9-8a85-ee4d6c5b297d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.029174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 191/400] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:11.030557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.031048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.031520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.043490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.046198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.047116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.047399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.047675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.048898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.050355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a344e0-040e-4604-9a17-3a6df5268851 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.052079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:11.052912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 210/401] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:10 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:11.053657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:11.054090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.054385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.056719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.071228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:11.072621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:11.087026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.141481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 192/402] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:11.143550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.154251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 211/403] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:11.188373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.258377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545010f-4194-44fb-8dc3-b407cf555d29 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.295597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abd35-1f30-4e15-a944-f5f050a10707 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.297962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.299125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.299606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.300076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.301487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.303283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.305459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 193/404] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:11.306464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.323800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.331491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.332369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.337000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.337000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.339032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.344008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:11.352596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:11.353669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:11.354693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:11.357165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 212/405] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:11.362435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.424162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a538f-d037-478a-bbb5-662d8aaa7eb7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.462534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.463697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.464221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.464631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.467234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a52ff-3315-461d-abf7-1e79bc446731 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.478147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:11.487076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:11.488063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:11.488970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:11.491850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 194/406] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:11.492847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.513829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.515131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.515563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.516236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/groups/c4b1e3439a354f86a2a8652105a33041/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.519110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, group_id=c4b1e3439a354f86a2a8652105a33041, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.521960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.593954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.608745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 213/407] 10.222.0.74 () {58 vars in 1442 bytes} [Fri May 27 15:01:11 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/groups/c4b1e3439a354f86a2a8652105a33041/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:11.609786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.612660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36af3-fac3-4fb6-ae12-1debeb06ec42 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.656098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.657155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.657592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.658000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.658931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:11.659414 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.661737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.672605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 195/408] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:11.678876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.709178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:11.801617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cea2f-be53-45fd-9cad-56952b8f7ea8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.848644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c19-de9f-4337-baf5-7dfe94600f3a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:11.849339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.850024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.850310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.850630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.851546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:11.851700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.853588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.868631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 214/409] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:11.869719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.896077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:11.897238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:11.897526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:11.897804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:11.899030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:11.900541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:11.902493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 196/410] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:11.911675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:11.936406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:12.041944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239724-08d6-43a6-81ee-c554ae6762fd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:12.059837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:12.072834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246994-267f-49a6-ad58-c40116c01673 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:12.109503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:12.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.110674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:12.110808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.111032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.112052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.112293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:12.112755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.113238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] PATH_INFO: `/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.113878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:12.118435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 197/411] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:12.119358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] RBAC: Authorizing `identity:get_group(group_id=f4441ab3cab34a09a4d6efe5ad7bb2b9)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:12.121039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:12.121808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:12.123413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 215/412] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:11 2022] GET /identity/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9 => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:12.128623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:12.216563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:12.233572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394af9a9-e111-4792-82af-bf0619ef37a3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:12.271504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:12.272411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.272697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.273133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/groups/c4b1e3439a354f86a2a8652105a33041/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.275802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] RBAC: Authorizing `identity:create_grant(project_id=801efd9cc4504ce9b34cd03882bdb5c6, group_id=c4b1e3439a354f86a2a8652105a33041, role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:12.277504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:12.323980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63032367-ea93-4968-a4ce-6b7a18531456 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:12.360200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:12.361103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.361392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.361723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] PATH_INFO: `/v3/projects/96792dba09744fc9ab793949f57108dd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.363035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] RBAC: Authorizing `identity:get_project(project_id=96792dba09744fc9ab793949f57108dd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:12.372005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 198/413] 10.222.0.74 () {58 vars in 1442 bytes} [Fri May 27 15:01:12 2022] PUT /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6/groups/c4b1e3439a354f86a2a8652105a33041/roles/018279cf41c14fa5b5d2a962378262e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:12.379058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a078-88a0-44b8-a1e6-e232023a0721 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:12.381551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 216/414] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:12 2022] GET /identity/v3/projects/96792dba09744fc9ab793949f57108dd => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:12.387318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:12.525009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9821f6-ac81-4b09-a762-537a213df645 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:12.571855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:12.572807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.573098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.573383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] PATH_INFO: `/v3/projects/96792dba09744fc9ab793949f57108dd/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.575426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] RBAC: Authorizing `identity:create_grant(project_id=96792dba09744fc9ab793949f57108dd, group_id=f4441ab3cab34a09a4d6efe5ad7bb2b9, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:12.576893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bf37b-46c0-4b4d-88cd-8eee77c7778c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:12.674758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 199/415] 10.222.0.74 () {58 vars in 1442 bytes} [Fri May 27 15:01:12 2022] PUT /identity/v3/projects/96792dba09744fc9ab793949f57108dd/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:12.716894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f3d1-e40f-4f34-bdae-087ae25e95d2 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.717252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f3d1-e40f-4f34-bdae-087ae25e95d2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.717558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f3d1-e40f-4f34-bdae-087ae25e95d2 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.719349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 217/416] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:12.725848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:12.726151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:12.726447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:12.733290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:12.751111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:12.752503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:12.834457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 200/417] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:12.869598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f3d1-e40f-4f34-bdae-087ae25e95d2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:12.944241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.004639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f3d1-e40f-4f34-bdae-087ae25e95d2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.042927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.043974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.044427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.044844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.061327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-a3deab0e-79a1-4c4b-b667-80b5e0007aec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:13.070187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:13.071301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:13.072287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:13.078435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 218/418] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:13.080218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.146458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a29b5-8d37-4b37-abd7-27d7bb3af537 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.146972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a29b5-8d37-4b37-abd7-27d7bb3af537 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.147394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a29b5-8d37-4b37-abd7-27d7bb3af537 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.150060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 219/419] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:01:13.154773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.155244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.155663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.176936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:13.178582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:13.233079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5cbaf-6abd-4c8e-8976-250f7f5c3a87 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.294610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 220/420] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:13.296357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.297043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.297330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.297605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.298365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:13.298698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:13.300081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:13.306535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.316796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 201/421] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:13.318015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.322297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.355478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.468579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4188ea-d8aa-48de-b9b9-e28caef5cbd4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.487898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d686d7-d6ea-4572-8d1e-4de803b82923 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.524404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.525174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.525528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.525880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.556497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.557322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.557610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.557889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.593132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.593442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:13.601343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:13.602003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:13.608263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:13.609068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:13.609676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:13.615499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 221/422] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:13.622619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.772599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 202/423] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:01:13.779822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.805926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.817003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1f9f-fe4d-4296-8c1a-be08c4c9014c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.874860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.876270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.876740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.877198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.878125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] RBAC: Adding query filter params (name=member) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:13.878676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:13.880334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:13.901035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 222/424] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:13.906826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:13.930851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.936337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bb58-2eba-429d-b779-1e30986eb55f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:13.977620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:13.978659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:13.978951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:13.979233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:13.980593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:13.982384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:13.984664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 203/425] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:13.995328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.063577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff57c9-9e25-4a02-ada9-d8abf1609736 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.107190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.107855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.108140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.108417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.148852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:14.216666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb11a-ee7e-49a4-8533-7c010f9e347d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.220776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:14.222251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:14.254707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.255572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.255981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.256242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.257533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:14.259095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:14.261079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 204/426] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:14.271620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.328352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:14.353392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 223/427] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:14.359354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.417794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9f9a-887e-4cea-8a59-c859ca9d94d1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.432067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:14.453651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.454310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.454649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.455126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.455735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=bff283621e36422286533f104dc729c2) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:14.456052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:14.457553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e45af4-2a50-40aa-97b8-3b89e7c09d80 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:14.470453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 205/428] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=bff283621e36422286533f104dc729c2&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:14.470453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce3cf-9122-4a9f-8a63-733082e98ddf None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.470453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce3cf-9122-4a9f-8a63-733082e98ddf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.470453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce3cf-9122-4a9f-8a63-733082e98ddf None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.470453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 206/429] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:14.484003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.484349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.484574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.500612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537ba3-8c5d-4a80-84ef-874328fc95b1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.510466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:14.510466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:14.588052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.588871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.589159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.589439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] PATH_INFO: `/v3/projects/bff283621e36422286533f104dc729c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.593421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] RBAC: Authorizing `identity:get_project(project_id=bff283621e36422286533f104dc729c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:14.594952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:14.596792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 224/430] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/projects/bff283621e36422286533f104dc729c2 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:14.602539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.655653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 207/431] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:14.713764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.755962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:14.763509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb755f-7b37-4b90-b4b2-158235ef77a2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.796734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:14.808644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.809518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.809807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.810092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.811325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:14.812893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:14.814853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 225/432] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:14.822839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.861716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671022a0-b337-4c84-a747-4a34551ca103 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:14.925768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:14.927483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:14.927969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:14.928721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:14.944002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:14.955318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:14.956226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 15:01:14.957083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:14.959928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 208/433] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:14.966278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:14.972667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fab-d783-4a87-9912-b15d6eaa5c22 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.010062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.010774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.011062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.011346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.012261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=bff283621e36422286533f104dc729c2) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:15.012496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:15.014205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:15.021682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 226/434] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=bff283621e36422286533f104dc729c2&role.id=239334dd0e7f463ea1f77dce601caeff => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:15.082100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.099326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895e26-204e-4b9b-b895-b70dc54b8605 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.144963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.145587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.145882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.146164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.146993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:15.147309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:15.148760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05426-d80f-42da-a19a-438c1509b82b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:15.159128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 209/435] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:01:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:15.167768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.239520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.286083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf988d9-1056-48cd-be35-d6276c8ac1db None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.305562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7515-8aee-4864-8e56-6568b3a65c77 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.306110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7515-8aee-4864-8e56-6568b3a65c77 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.306110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7515-8aee-4864-8e56-6568b3a65c77 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.307782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 210/436] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:15.313435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef419d8-5d4e-46c1-af74-6456bd8691e8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.313762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef419d8-5d4e-46c1-af74-6456bd8691e8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.314000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef419d8-5d4e-46c1-af74-6456bd8691e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.326320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.327061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.327459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.327734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.334304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8ef419d8-5d4e-46c1-af74-6456bd8691e8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:15.335727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8ef419d8-5d4e-46c1-af74-6456bd8691e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:15.406983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:15.408374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:15.420383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 211/437] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:15.421826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3cca-57a6-4a86-b9bf-a2c033e8e49b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.422113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3cca-57a6-4a86-b9bf-a2c033e8e49b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.422390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3cca-57a6-4a86-b9bf-a2c033e8e49b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.423875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 212/438] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:15.429159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.429449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.429726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.448972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:15.450185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:15.483338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.530991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 227/439] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:15.531838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.540369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 213/440] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:15.541250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.551567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.656464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10de5c-1dc6-47a1-b3ad-fdae18dc1315 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.665851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31250-b0c0-49f8-b642-70c8ac7b3af4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.696966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.697783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.698069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.698346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.702479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613271-782f-434e-ae31-de526a623742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.703321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613271-782f-434e-ae31-de526a623742 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.703601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613271-782f-434e-ae31-de526a623742 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.703870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613271-782f-434e-ae31-de526a623742 None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.705028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613271-782f-434e-ae31-de526a623742 None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:15.706507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613271-782f-434e-ae31-de526a623742 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:15.708384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 214/441] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:15.709138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613271-782f-434e-ae31-de526a623742 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.709346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:15.718032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:15.719169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 228/442] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:15.720030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.739923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.789188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.811727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613271-782f-434e-ae31-de526a623742 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.823601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a389d6c-a160-47c1-844d-b753f7e8614a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.846837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.847628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.847917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.848197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.858161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:15.858290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:15.859107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:15.859393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:15.859669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:15.860837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:15.862284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:15.864466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 229/443] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:15.865219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:15.865931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:15.866828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:15.867714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:15.870654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 215/444] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:15.871489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:15.954283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.969008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e397f5-1946-4581-b456-32b54b2589db None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:15.971696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39bb2-53c4-4d7a-8099-54ed5d3b1205 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.002869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.003528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.003809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.004603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.005685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:16.005995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.006473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.007134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.007390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.007480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.007693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.008539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=239334dd0e7f463ea1f77dce601caeff, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:16.008847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.010276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.013377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.015859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 230/445] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:16.016643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.028487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 216/446] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:15 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=239334dd0e7f463ea1f77dce601caeff => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:16.028487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.131061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509dc7b-6287-44c0-908f-34948faa8d93 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.131409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191a43-3f1a-4979-b0d5-2b490ee722ef None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.168655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.169326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.169456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.169651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.169890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.169985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.170267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.170682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.171431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:16.171741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.173257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.187779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 231/447] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:16.189214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.204057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.260110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.262405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.264377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.313111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e398f-bd9e-4515-9462-080c751b8991 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.355610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.356313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.356606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.356883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.383082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 217/448] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:16.389623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.439408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.440858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.452502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.496719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.499749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3e9ac-69ce-4dc9-85af-42987a0d0e90 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.534113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.534932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.535220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.536151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] PATH_INFO: `/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.537498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] RBAC: Authorizing `identity:get_project(project_id=801efd9cc4504ce9b34cd03882bdb5c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.539007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.540685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 218/449] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/projects/801efd9cc4504ce9b34cd03882bdb5c6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:16.542967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 232/450] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:01:16.546037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.548279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.646389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177529e9-aafb-4b51-8f61-521b56edc39f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.648528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803aa85-33be-433b-a2de-d468d4b1ce58 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.659003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.680590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.681433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.681709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.681978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] PATH_INFO: `/v3/groups/c4b1e3439a354f86a2a8652105a33041` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.682750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.683164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] RBAC: Authorizing `identity:get_group(group_id=c4b1e3439a354f86a2a8652105a33041)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.683600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.683924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.684292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] PATH_INFO: `/v3/projects/96792dba09744fc9ab793949f57108dd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.684669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.685721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] RBAC: Authorizing `identity:get_project(project_id=96792dba09744fc9ab793949f57108dd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.686461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 219/451] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/groups/c4b1e3439a354f86a2a8652105a33041 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:16.687492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.693983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 233/452] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/projects/96792dba09744fc9ab793949f57108dd => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:16.694113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.694902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.726745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.792062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c9b7-6ae4-46ec-95ca-2646a7e5903a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.796339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950b3d-0fef-4324-bfa3-3219d26c281a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.825971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.826680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.826965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.827392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.828071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] RBAC: Adding query filter params (group.id=c4b1e3439a354f86a2a8652105a33041, role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:16.828385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.829897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.836455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 220/453] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/role_assignments?group.id=c4b1e3439a354f86a2a8652105a33041&scope.project.id=801efd9cc4504ce9b34cd03882bdb5c6&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:16.836581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] PATH_INFO: `/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] RBAC: Authorizing `identity:get_group(group_id=f4441ab3cab34a09a4d6efe5ad7bb2b9)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648af7e-5bb3-4d61-b128-4c0b4b7a705b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:16.845641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 234/454] 10.222.0.74 () {56 vars in 1180 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/groups/f4441ab3cab34a09a4d6efe5ad7bb2b9 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:16.850103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:16.955906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:16.959609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fea65-0264-4cf4-9da8-8200c8dd40a9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:16.995355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:16.996083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:16.996369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:16.996644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:16.997534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] RBAC: Adding query filter params (group.id=f4441ab3cab34a09a4d6efe5ad7bb2b9, role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=96792dba09744fc9ab793949f57108dd) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:16.997848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:16.999337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee077c4f-b182-4614-bb8c-438cfef18d97 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:17.005776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 221/455] 10.222.0.74 () {56 vars in 1376 bytes} [Fri May 27 15:01:16 2022] GET /identity/v3/role_assignments?group.id=f4441ab3cab34a09a4d6efe5ad7bb2b9&scope.project.id=96792dba09744fc9ab793949f57108dd&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:19.615456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e9a-3f8b-4fa6-a10a-0202bb1716e4 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:19.616142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e9a-3f8b-4fa6-a10a-0202bb1716e4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:19.616142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e9a-3f8b-4fa6-a10a-0202bb1716e4 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:19.617630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 235/456] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:19.623385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efecc5-1f2a-4586-a8eb-1ae189761484 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:19.624178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efecc5-1f2a-4586-a8eb-1ae189761484 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:19.624645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efecc5-1f2a-4586-a8eb-1ae189761484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:19.651433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-21efecc5-1f2a-4586-a8eb-1ae189761484 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:19.652712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-21efecc5-1f2a-4586-a8eb-1ae189761484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:19.747270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 222/457] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:19.780900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7311e9a-3f8b-4fa6-a10a-0202bb1716e4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:19.857511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:19.911810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335fb2-79c0-4e0f-b424-d2c2ffdb019a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:19.912514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335fb2-79c0-4e0f-b424-d2c2ffdb019a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:19.913002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c335fb2-79c0-4e0f-b424-d2c2ffdb019a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:19.915798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 223/458] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:19.924748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:19.925597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:19.926722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:19.963547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:19.964989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7311e9a-3f8b-4fa6-a10a-0202bb1716e4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:19.966397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:20.055953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.056796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.057086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.057369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.077166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 224/459] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:20.086300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.087980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.102575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4eef3e0a-86f1-4063-80d4-dba4dbbe39bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:20.114611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:20.115612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:20.116465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:20.116465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:20.116465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.116465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:20.116465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 236/460] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:20.117554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb107-3b83-45d8-aaad-74dc86462c6b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.117847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb107-3b83-45d8-aaad-74dc86462c6b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.122481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddb107-3b83-45d8-aaad-74dc86462c6b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.122481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 237/461] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:20.124181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddb107-3b83-45d8-aaad-74dc86462c6b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.174765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.231372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d308-0e08-4f28-8b05-41f013e56f42 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.242050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.248679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddb107-3b83-45d8-aaad-74dc86462c6b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.278862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.280116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.280674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.280961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.292047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.293029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.293513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.294021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.295027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:20.295268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.295764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.296769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.297548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9370c6-e1d8-49b3-b9cc-5a2ad978759f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.311132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 238/462] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:20.312754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.313264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.313812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:20.318464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:20.319405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:20.320261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:20.320261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:20.320261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.320261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:20.320261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 225/463] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:20.320531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.334818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:20.336331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:20.419174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.422551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 239/464] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:20.423657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.456695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6145-94e7-4fe2-8290-dc17caeb0c10 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.493706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.494373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.494691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.494972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.495964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.497866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d2dc0-9bfa-4876-9085-dfd862b6ef61 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.526434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.539174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2816af6-043e-40d7-9679-de7ada7ca348 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.573365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.574039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.574345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.574660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.575385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:20.575698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.577076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b87e-ded4-4827-91de-628041b3a279 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.587340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 226/465] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:20 2022] POST /identity/v3/users => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:20.588594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140703-c58d-4cb8-912a-8fd50167c08a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.588961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140703-c58d-4cb8-912a-8fd50167c08a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.589224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140703-c58d-4cb8-912a-8fd50167c08a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.595064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 227/466] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:20.595064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140703-c58d-4cb8-912a-8fd50167c08a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.599889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 240/467] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:20.601362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.601657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.601943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.622940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:20.624212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:20.714528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 241/468] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:20.714528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.736336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140703-c58d-4cb8-912a-8fd50167c08a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.783743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.792416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.793731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.794026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.797845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.806066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.807644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.807888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:20.828148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:20.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:20.829910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:20.829910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:20.829910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:20.829910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:20.833196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 228/469] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:20.834440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:20.846472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90a995-bf0a-4f20-affb-42af58d64804 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.905893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.906575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.906865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.907147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:20.907864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:20.909363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:20.962174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f6b7-382a-4a2c-94e9-9e21412e2e9c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:20.998152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:20.998922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:20.999209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:20.999497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.010732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.012248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:21.031617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:21.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 229/470] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:21.033757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.045003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 242/471] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:20 2022] POST /identity/v3/users => generated 248 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:21.049210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.079374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:21.232551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728511c1-3833-4781-81bc-2cb416d5af60 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:21.246580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5503-93a0-42c5-af04-f699b1b4655b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:21.271639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:21.272234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.272521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.272802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.273541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:21.273851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.275283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a18d9-8880-408c-8045-f571c9d87ec8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.276893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:21.287743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 243/472] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:21.288907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ebcf-5295-4d18-971c-295a345f5986 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.290718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ebcf-5295-4d18-971c-295a345f5986 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.290718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ebcf-5295-4d18-971c-295a345f5986 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.294447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 244/473] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:21.294568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ebcf-5295-4d18-971c-295a345f5986 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.300430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:21.301960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.302569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.303062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.304446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:21.304958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.306948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06892ba-46d5-44e8-abfa-0abefa161b10 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.323644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 230/474] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:21.325213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.325514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.325795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.347481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:21.348812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:21.413941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ebcf-5295-4d18-971c-295a345f5986 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:21.440340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 231/475] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:21.442535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.463650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:21.464749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.465292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.465824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.466777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.468518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.483657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:21.557501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4534-7267-40d4-a643-bd3b7287cec5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:21.594439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 245/476] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:21 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:21.594439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.614759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:21.615654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.617022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.617022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.617022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.619793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.678908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:21.730680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b2a2-847b-4399-9c96-9d5694c4d3cd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:21.741178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 232/477] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:21 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:21.787665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:21.788410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:21.788694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:21.788970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:21.789726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:21.791249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:21.845287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.sql.core [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 15:01:21.845287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 15:01:21.845287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [parameters: {'id': '84df517cf6aa42e49b93589a2bf7d955', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 15:01:21.845287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80536) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application conn.query(q) May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result.read() May 27 15:01:21.863333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return ref.to_dict() May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:01:21.865237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application next(self.gen) May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application yield resource May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application next(self.gen) May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.session.rollback() May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.force_reraise() May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise self.value May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application session.commit() May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 15:01:21.866207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._prepare_impl() May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.session.flush() May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._flush(objects) May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application compat.raise_( May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application flush_context.execute() May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rec.execute(self) May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 15:01:21.868189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:01:21.870648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application conn.query(q) May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result.read() May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:01:21.872768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [parameters: {'id': '84df517cf6aa42e49b93589a2bf7d955', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:21.874963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 15:01:21.876693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:21.881765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 246/478] 10.222.0.74 () {60 vars in 1131 bytes} [Fri May 27 15:01:21 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:21.881896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:21.984536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:22.005764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959360c-2967-47b2-aa9d-731599d1e742 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:22.045445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:22.046788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:22.047065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:22.047335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:22.058853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-80b61a8a-fe26-49a3-8c15-f62c7c607b59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:22.067541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:22.069309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:22.070265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 233/479] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:01:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:22.075015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:22.179266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa0d6-12e7-4b91-b1db-f17b0624ec7c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:22.194584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:22.214931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:22.215616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:22.215886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:22.216163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:22.216903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:22.217211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:22.218595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cb271-cc3e-4ee9-b7d5-2e76eea09231 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:22.228065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 247/480] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:23.123414 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd627-e655-4382-bc88-79e509b3a2f7 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.123958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd627-e655-4382-bc88-79e509b3a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.123958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd627-e655-4382-bc88-79e509b3a2f7 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.125545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 234/481] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:23.131202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.131636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.131811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.164885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:23.166004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:23.237792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 248/482] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:23.261048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd627-e655-4382-bc88-79e509b3a2f7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:23.392762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd627-e655-4382-bc88-79e509b3a2f7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:23.437349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:23.438152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.438444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.438723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.455232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:23.463241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:23.464143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:23.464952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 235/483] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:23.470350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:23.606132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e32c16-7822-427e-82c8-5627d77c7e3a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:23.614333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:23.656515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:23.657203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.657500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.657782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.658563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:23.658877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:23.660268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10144230-01e1-467d-bc32-f8a11ebaa885 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:23.674236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 249/484] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:23.680265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:23.698036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:23.817994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1a8fa-0e83-4f2d-a890-c3ceed72bc79 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.818327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1a8fa-0e83-4f2d-a890-c3ceed72bc79 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.818600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1a8fa-0e83-4f2d-a890-c3ceed72bc79 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.820349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 250/485] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:01:23.826183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.826498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.826785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.830041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c07c0-55b2-4c6d-a0d2-716543c1940e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:23.850798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:23.851990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:23.894365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:23.895770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:23.896052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:23.896322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:23.918794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:23.920285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:23.955543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:23.956431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:23.957882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:23.957882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:23.957882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:23.957882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:23.962724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 236/486] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:23.964054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:23.985752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 251/487] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:24.040603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.062387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.187237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f405-726e-4c0a-9523-1ccf6a62eaef None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:24.232214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487e6c1-761f-406e-8047-c525ae531ed5 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:24.250793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.260861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:24.264518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.264518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.264518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.264518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:24.264518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:24.264988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:24.280000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 237/488] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:24.287802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.307705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:24.308720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.309049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.309402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.339842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:24.354924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:24.355915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:24.357150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 252/489] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:24.378758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.496475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c39e-ecee-4e38-a0af-812e686af0e6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:24.516380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.541870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:24.542706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.542990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.543244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.552684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:24.554903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:24.577309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5562-b5d6-4f31-862f-a4e52f00eefa None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e2ae658d-99d6-4219-8fc3-7e9233b439dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:24.578193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:24.579136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:24.580505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:24.584910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 238/490] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:24.586964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40985-456f-4071-a93c-8236b7b3c793 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.587255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40985-456f-4071-a93c-8236b7b3c793 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.587535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40985-456f-4071-a93c-8236b7b3c793 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.589088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 239/491] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:24.593979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c40985-456f-4071-a93c-8236b7b3c793 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.628943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:24.630628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.631164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.631727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.632666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:24.633163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:24.634732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0cf23-46eb-4763-9630-03c3fe8ddecd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:24.649230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 253/492] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:24.651013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.651512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.651987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.669572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:24.671134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:24.688937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.722670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c40985-456f-4071-a93c-8236b7b3c793 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:24.754865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 254/493] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:24.756278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.775232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:24.776359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:24.776359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:24.776633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:24.779098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:24.779415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:24.781176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:24.844332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 240/494] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:24.844332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:24.904124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.955186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55153c-2aa8-47bd-aba9-b068b5a7df99 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.002743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebeb11-f79f-4846-a3e8-74721739c043 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.007676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.008910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.009409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.010017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.023776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.025585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:25.046606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.047593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.048441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:25.048441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:25.048441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.048441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:25.054786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 255/495] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.055152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.056071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.056372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.056557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.056651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.060806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.073073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:25.083792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.084693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:25.085503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:25.088483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 241/496] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.089545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.177036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bfd0-3efd-4956-a301-45bf502f9fc4 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.189859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.198204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ac6d8-632b-4341-b0bd-b07dabc22238 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.211397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.212048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.212414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.212610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.232298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.233017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.233310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.233594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.234315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:25.234659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.236072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dafd-7010-4af8-b89b-e376fc90fd4d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.248139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 242/497] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:25.249462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb38b-96ba-4dd1-9953-1336851e5da0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.249762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb38b-96ba-4dd1-9953-1336851e5da0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.250042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb38b-96ba-4dd1-9953-1336851e5da0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.251314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 243/498] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:25.252012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb38b-96ba-4dd1-9953-1336851e5da0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.289589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.291677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd506ca5-5a1e-4bf4-a7c3-e67316a8ed48 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.293633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.356859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb38b-96ba-4dd1-9953-1336851e5da0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.392981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 256/499] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:25.394308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1e10-e4da-42df-8e85-2d341259657a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.394628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1e10-e4da-42df-8e85-2d341259657a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.394934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1e10-e4da-42df-8e85-2d341259657a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.396408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 257/500] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:25.396928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c1e10-e4da-42df-8e85-2d341259657a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.399240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.399911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.400342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.400637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.401374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:25.401680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.403105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c8b07-bef6-427b-901f-8ea182bb4f91 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.411469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 244/501] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:25.412739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.413846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.414592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.431838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:25.433032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:25.442802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.501008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 245/502] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:25.501855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.517277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c1e10-e4da-42df-8e85-2d341259657a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.519179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.553182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.553882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.554163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.554461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.561498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.562995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-f763766f-7392-4593-ab00-7c657d680266 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:25.578847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.579781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:25.580680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 258/503] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.581249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.581488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.581738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.598764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:25.600113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:25.603515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888b6d-4323-4352-b326-05ca102eea83 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.638855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.639651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.639952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.640213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.650628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.652736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.656493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.668326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 259/504] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:25.669177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:25.682190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.683115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.684016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:25.684016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:25.684016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.684016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:25.684240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 246/505] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.685222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.770338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.778360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf3764-f59a-4cf1-a0ee-a526151a3c2c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.793614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e1-5666-4de1-b774-da20b40f5489 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.813235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.813971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.814259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.814571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.824592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.826051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.827702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.828491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.828779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.829054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.839623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:25.844554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.845387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.846239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:25.846239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:25.846239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:25.846239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:25.846239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 260/506] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.847081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:25.847358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:25.848260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:25.849077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:25.853308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 247/507] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:25.854160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:25.911206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:25.951657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29456c-9d6d-4613-afa5-182569e47f99 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.955682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c528a-58a3-4178-bafd-d1dac98a498b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:25.984474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.985142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.985423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.985699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.986549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:25.986855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.988343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:25.995068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:25.995743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:25.996031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:25.996312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:25.997043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:25.997407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:25.998852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.011746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 248/508] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.012623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.028662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 261/509] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.029454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.032325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.114734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669791c-769e-473e-a612-5c510ec0fa9a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.131225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.137090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2d04-3246-4f85-a4e7-e05d0f474711 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.148737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.149520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.149801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.150074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.160099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.162304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.172851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.173511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.173801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.174081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.174839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:26.175148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.177266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:26.180195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:26.181182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:26.182110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:26.182110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:26.182110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:26.182110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:26.182110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 249/510] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:26.182376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.192195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 262/511] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.193525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.252432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.287866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd474ad-4510-46d8-b45e-6c80b81e347f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.295946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b589a-13ce-4cde-aeac-6f09f6ebab49 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.323519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.324188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.324480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.324752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.325496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:26.325804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.327214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.330037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.330884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.331173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.331453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.336293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 250/512] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.337088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.339240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.340709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:26.355803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:26.356689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:26.357570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 263/513] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:26.358033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.367422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.436082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1253-b026-49e9-a1cb-c07c2f24a1f2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.458511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431e8f-c997-411d-9e26-e6c02fef4ed5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.470228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.470909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.471196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.471481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.484960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.496822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.499429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.499429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.499429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.499429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:26.499429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.500621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.512196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 264/514] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.513256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.539734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.541198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.570044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.612338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a5fd-9f98-47f0-a3f6-73850db948a3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.644031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 251/515] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:26.645621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.652381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.653190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.653477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.653786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.666777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.668221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:26.683097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:26.685950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 265/516] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:26.686891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.729970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.751428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b092-e635-45f9-a536-cfedd0954965 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.781351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.786868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1900dd-f365-4b61-9ce0-020d13249604 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.787451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.788236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.791359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.791359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.799056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.800521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:26.817885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:26.818805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:26.819655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:26.819655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:26.819655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:26.819655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:26.819655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 252/517] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:26.819926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.824275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.824938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.825222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.825499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.826279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:26.826623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.828073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.845990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 266/518] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:26.846816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:26.920008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715a789-0eec-4fca-9a28-6dfed54c5cf3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.947438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0549f-934a-472f-b394-c4d99949a847 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:26.949048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.959367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.960049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.960332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.960609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:26.961317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:26.962847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:26.991242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:26.992039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:26.994847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:26.994847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.002481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.003948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:27.022674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:27.023698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 267/519] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:27.025038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.068247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 253/520] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:26 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:27.068247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.114055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.137781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1002c-8a8e-4d0f-9747-a9a93825db9d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.183281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c737-dcf1-44b8-8289-ae5ebc54038d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.185829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.187462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.187759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.188043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.188906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:27.189222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.190858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.212818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 268/521] 10.222.0.74 () {56 vars in 1139 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:27.213842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.229266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.229966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.230221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.230350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.230557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.231286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:27.231600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.233023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.245570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 254/522] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:27.246445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.334743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4daea-ca45-4178-bf58-816e14513d62 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.363116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.368093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81210-2c21-4028-8d7d-823bcb4001e7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.372966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.373990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.374444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.374867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.375834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:27.376392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.377976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.384316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 269/523] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:27.385452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.415599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.416640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.417120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.417579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.418510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:27.419037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.420699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.442828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 255/524] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:27.445934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.489062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.516335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79343-415f-4684-99f1-2bb0f0ec4a6b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.556854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.557528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.557817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.558099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.596584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a0235-db13-466b-8243-af73df8308b0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.640292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.644370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.644370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.644370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.650986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.652632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.657029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.658499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:27.668294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:27.669420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:27.670437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:27.671355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 256/525] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:27.672603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.697917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.762246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.783530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760d05-1203-463d-8f31-d926757bd2fb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.793427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 270/526] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:27.794397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.823920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.825213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.825809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.826356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.834564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.836533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:27.853052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:27.853962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:27.854844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:27.861689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 257/527] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:27.862908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:27.916830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5fa68-090d-48bb-97bd-aa2e5cbf0065 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.958726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:27.959395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:27.960985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:27.961471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:27.961970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:27.963044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:27.963555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:27.965190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:27.984093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26083d-6468-4473-a513-3e2d1367c34f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:27.984875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 271/528] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:27.985912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.025522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.032487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.033518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.034062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.035463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.046078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.047812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:28.066257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:28.067796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:28.068660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:28.068660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:28.068660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:28.068660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:28.070903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 258/529] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:28.071920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.112611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87be01-d2ee-49d5-941a-fa75d254b2ec None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.152267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.153312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.153791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.154276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.155286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:28.155788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.157512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.174633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 272/530] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:28.176415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.193492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d8f4-9092-4086-b96e-02ed283f1d67 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.229978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.236842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.237859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.245087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.245087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.289935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.297515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dcd18-f3a3-4da1-90f6-e41fb994e7fa None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.313588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.315411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.336087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.336760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.337052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.337336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.338063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:28.338374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.339899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.352638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 273/531] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:28.353238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.421928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 259/532] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:28.423441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.453969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.468164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0370-a0e9-43cb-b89a-bdca06ba22bd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.505695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.506385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.506745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.507031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.508210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=f2be3143a237450a80f2fcb01a0c2e6e) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:28.508319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.509711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.522445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 274/533] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/role_assignments?user.id=f2be3143a237450a80f2fcb01a0c2e6e&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:28.522445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.540494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.544834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842ea-588a-4786-9686-887b8b3ee7c3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.636767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b235ca-25dd-4f4b-b561-f8428043f6b6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.651241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.652080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.652369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.652654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.671703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.673277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.679874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.680699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.680988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.681269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:28.696154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:28.697076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:28.697935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 260/534] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:28.708099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.709604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.715084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:28.741574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:28.742512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:28.743353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:28.743353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:28.743353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:28.743353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:28.743353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 275/535] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:28.747700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.826916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.831682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.838021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204dbb-c770-4829-9ba3-86a3ded08190 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.865381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343fd2-e7cc-4726-9079-cc6f51f436b0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:28.873631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.874438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.874836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.875215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.876121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:28.876530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.878094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.898821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 261/536] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:28.902841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:28.903522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:28.903811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:28.904095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:28.904652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:28.904825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:28.905143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:28.908944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:28.919137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 276/537] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:28.931528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:29.078525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5581d-a575-4421-9b44-6148781e30aa None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.082172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e758f-4fc5-438a-8d1f-e9be3e43b82d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.108502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:29.115211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.116024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.116610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.116895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.124156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:29.125618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:29.140974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:29.141886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:29.142844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 277/538] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:29.151380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:29.167128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.168090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.168588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.169056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.170099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ec341a30b5274ebc9b12e0bdad2ed8a8) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:29.170640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:29.172267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:29.187504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 262/539] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:28 2022] GET /identity/v3/role_assignments?user.id=ec341a30b5274ebc9b12e0bdad2ed8a8&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:29.274090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3f46-46be-4a29-a10b-8eb9ca701672 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.322948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.323649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.323938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.324223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.325043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:29.325358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:29.326906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb855e7-96e4-4dde-b840-c08ba76cc303 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:29.340973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 278/540] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:29.346525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:29.372707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:29.437204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc214bb-ae61-4a7d-b280-f1cd9486c72a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.437890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc214bb-ae61-4a7d-b280-f1cd9486c72a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.438373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc214bb-ae61-4a7d-b280-f1cd9486c72a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.446571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 279/541] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:01:29.452137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.452725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.453234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.481958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:29.483565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:29.489049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907701-41cd-4c34-93ba-c68ca594fd21 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.533757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.534439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.534749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.535023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.536656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=11e6cdc7569b419fa70ba6524b5a4c24) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:29.536968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:29.538404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:29.545375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 263/542] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:29 2022] GET /identity/v3/role_assignments?user.id=11e6cdc7569b419fa70ba6524b5a4c24&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:29.564906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:29.604482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 280/543] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:29.652686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:29.742584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:29.766566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894be21-3857-45fa-b04a-c32852817e27 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.804320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.805146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.805429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.805706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.819508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:29.827520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:29.828493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:29.829505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 264/544] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:29.835219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:29.939809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce939-27a8-4cff-a786-92b4f43292cf None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:29.977433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100977c9-974d-4423-946a-80265364323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:29.978111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100977c9-974d-4423-946a-80265364323e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:29.978392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100977c9-974d-4423-946a-80265364323e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:29.978695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100977c9-974d-4423-946a-80265364323e None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:29.979439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100977c9-974d-4423-946a-80265364323e None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:29.979746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100977c9-974d-4423-946a-80265364323e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:29.981111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100977c9-974d-4423-946a-80265364323e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:29.991158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 281/545] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:29.998583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.133136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708f34-1bf1-400d-b171-515ef4ac45f9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:30.177142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:30.177975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.178242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.178520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.190483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:30.195184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:30.196791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4c24a0a3-94b2-423a-9e26-3a71e5ccc77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:30.218499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:30.219420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:30.220439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:30.220439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:30.220439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:30.220439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:30.220439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 265/546] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:30.227556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100977c9-974d-4423-946a-80265364323e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.264700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c8ff-6ad4-4dd0-959a-af7c807ac27b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.265029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c8ff-6ad4-4dd0-959a-af7c807ac27b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.265260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c8ff-6ad4-4dd0-959a-af7c807ac27b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.266649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 266/547] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:01:30.272976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.273263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.273541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.296625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:30.299824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:30.302138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:30.410360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 267/548] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:30.411008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100977c9-974d-4423-946a-80265364323e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:30.454783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.467879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:30.468848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.469337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.469843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.470807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:30.471338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:30.473085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:30.486801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 282/549] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:30.499306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.597003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9dec0-c690-4405-b992-726a40e8fb36 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:30.623842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:30.634843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:30.635647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.639429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.639429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.647427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:30.655333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:30.656258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:30.657599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 268/550] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:30.665356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.736634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc9b9-a1ae-4254-b5ba-1584627f3eb3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:30.738121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:30.799893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eda71-8530-44ed-b0b3-2b140b384495 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:30.813254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:30.814130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.814433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.814737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.824335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:30.825796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:30.842447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:30.843407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:30.844915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 283/551] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:30.849034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.883404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:30.884077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:30.884401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:30.884678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:30.885434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:30.885739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:30.887990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:30.907875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 269/552] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:30.912595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:30.988994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.043667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97a36-734d-4981-9513-164deec6640a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.047242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14c8d0-4248-4d18-878c-effd33fd6ef3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.082527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.083565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.083855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.084195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.094821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.096468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.108471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.109496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.109779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.110649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:31.110963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.112394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:31.114612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:31.115627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:31.116602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:31.116602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:31.116602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:31.116602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:31.116602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 270/553] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:31.123345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.154200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 284/554] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:01:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:31.159995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.213798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.235763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37e7c-ac0c-4a8e-8952-e64d612d46c3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.245853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.273709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.274492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.274848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.275200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.276103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:31.276484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.278026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.290453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 271/555] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:31.295490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.411733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9bb1-5ce9-44af-8c9b-072a2d17e94a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.415379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b1a4-ed9e-4475-a9fd-9b0f22cf4c88 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.453234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.454276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.454907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.455333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.456168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.457027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.457479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.458016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.468079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.470057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-53526140-6693-4dbf-b6ea-95decc482857 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:31.490748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:31.491981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:31.494583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 272/556] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:31.495283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b731-3d86-4e61-8b64-6270bff33a94 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.495283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b731-3d86-4e61-8b64-6270bff33a94 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.495498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b731-3d86-4e61-8b64-6270bff33a94 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.497362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 273/557] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:31.499661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693b731-3d86-4e61-8b64-6270bff33a94 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.521969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.547628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.549078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961d2cd-a3dd-493a-8b3d-90802ab555da None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.576302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.641619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693b731-3d86-4e61-8b64-6270bff33a94 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.667349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 285/558] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:31.668976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.669333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.669774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.683372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.684308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.684405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.684668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.685532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:31.685843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.687374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.728567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 274/559] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:31.728567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.733388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:31.735542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:31.806537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 286/560] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:31.807586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.836758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.874367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb29fe-2a83-442a-b7d6-21ac15b61b3d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.882700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:31.918176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.919304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.919808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.920196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.931359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.933707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:31.935308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001fb92-b585-4caa-bf69-df1ea10c29b6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:31.963318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:31.965065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 275/561] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:31.966871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:31.977483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:31.978282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:31.978593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:31.978865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:31.989984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:31.991628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-027904de-09ef-4a0c-af40-add9930c3cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:32.011766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.012816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.013989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:32.013989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:32.013989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:32.013989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:32.013989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 287/562] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.014890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e256-9b8f-41c2-abd2-f014d5cd9604 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.015179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e256-9b8f-41c2-abd2-f014d5cd9604 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.015548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e256-9b8f-41c2-abd2-f014d5cd9604 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.021326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 288/563] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:32.021326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33e256-9b8f-41c2-abd2-f014d5cd9604 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.083588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8366e-4088-4a54-8f38-9de42c3a2afe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.106261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.117434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.118224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.118541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.118824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.121368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33e256-9b8f-41c2-abd2-f014d5cd9604 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.122929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.129810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:32.138043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.145144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 276/564] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.146100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.156096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.156762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.157052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.157328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.158046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:32.158353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.159746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9957e-2738-4eb3-9c8f-4ec8c888e474 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.171742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 289/565] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:32.172936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e829-aa13-4523-8d4e-5c3492dfd1a4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.173230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e829-aa13-4523-8d4e-5c3492dfd1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.173513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e829-aa13-4523-8d4e-5c3492dfd1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.189817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6225e829-aa13-4523-8d4e-5c3492dfd1a4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:32.191034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6225e829-aa13-4523-8d4e-5c3492dfd1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:32.245797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb111-0864-44a4-a866-f6a2267bea90 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.258021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 290/566] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:32.259541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba04d-1a89-4896-a14d-26d146369b6e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.259657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba04d-1a89-4896-a14d-26d146369b6e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.259938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba04d-1a89-4896-a14d-26d146369b6e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.262460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 291/567] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:32.262460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ba04d-1a89-4896-a14d-26d146369b6e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.283185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.283837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.284118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.284396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.285104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:32.285921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.287324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.298733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 277/568] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:32.303325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.347657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.364211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.373293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ba04d-1a89-4896-a14d-26d146369b6e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.403133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd8ef-c0b8-4507-b05f-b0688d742b7c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.407531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.408211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.408680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.409117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.410203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:32.410579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.411957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3ac1a-c8b9-42e4-bc3d-97938a76bf93 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.420104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 292/569] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:32.421371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27bd24-078d-411c-9442-46e682988899 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.421666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27bd24-078d-411c-9442-46e682988899 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.421949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27bd24-078d-411c-9442-46e682988899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.437170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.437789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-1a27bd24-078d-411c-9442-46e682988899 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:32.437954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.438233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.438541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.439078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1a27bd24-078d-411c-9442-46e682988899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:32.445668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.447162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:32.461195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.462217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:32.463174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:32.466681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 278/570] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.467407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.506907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 293/571] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:32.507749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27bd24-078d-411c-9442-46e682988899 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.575109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669b6-b786-49f1-8416-2a4fc5b66438 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.577378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.593958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.608455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.609183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.609463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.609736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.609845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27bd24-078d-411c-9442-46e682988899 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.620129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:32.627863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.628994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:32.629879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 279/572] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.630620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.646350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.647233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.647875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.648155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.654986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.656497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:32.671527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.672589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:32.673534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 294/573] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.674032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.733814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabddfd-15a7-45bf-b7ae-22463ae81e58 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.768960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.769794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.770086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.770365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.775664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7494-96a6-406f-9666-0090218cb591 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.780691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.782161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:32.799111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.800028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.801432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:32.801432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:32.801432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:32.801432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:32.801432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 280/574] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.801724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.811065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.811821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.812172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.812506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.813348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:32.813719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.815276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.820316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.827983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 295/575] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:32.828769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.834269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:32.903129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12c4e4-7291-4b5f-a872-21e16ccb3d55 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.930703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46fde-489f-4911-b509-b0626fbc0585 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:32.939027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.939893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.940246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.940588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.951421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:32.959293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:32.960413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:32.961319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 281/576] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:32.962037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:32.968483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:32.969164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:32.969448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:32.969725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:32.970915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:32.971231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:32.972597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:32.981170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 296/577] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:32.981949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.044962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.046161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.067778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4290-2301-4e3b-a3f6-bbcdc585019f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.080151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505717-3889-4119-b004-d740ac33c748 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.101365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.102140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.102518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.102862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.103710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.104090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.105721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.114895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.115566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.115852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.116134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.116855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.117164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.118535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.123353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 282/578] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.123353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.131070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 297/579] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.131880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.221725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8ae-e8ea-43a4-9d13-783ebb236908 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.235533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1795-69d2-4faa-9692-9bc8ba1f960f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.255995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.256638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.256915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.257188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.258011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=29d1b699dac04f23bf3e2f6cd54d33a4) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.258313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.259763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.261740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.263436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.266098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 283/580] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/role_assignments?user.id=29d1b699dac04f23bf3e2f6cd54d33a4&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.266890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.271547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.275369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.275369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.275369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.275369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.275369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.276647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.290569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 298/581] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.290569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.387296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7f8a5-96e6-446a-99f3-4abe58fee0a6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.414750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d13e2-029e-4d6c-a0eb-c560455ff553 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.427896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.428714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.429000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.429275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.440768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.443139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.452073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.452975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.453261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.453539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:33.463189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:33.464097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:33.465008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:33.465008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:33.465008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:33.465008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:33.465008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 284/582] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:33.465291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.475525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=4af65d40347141eebeb01eb446f93766, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.476898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.517688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.548127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 299/583] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:33 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:33.559597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.575361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55abec-0198-4700-973e-3b506c0beb21 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.615479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.619487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.620711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.621243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.621745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.633367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.635429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:33.653747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:33.654831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:33.655817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:33.658670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 285/584] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:33.659843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.695495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537484c7-7444-41e3-940e-033b0aa2a621 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.770016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.771657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.771951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.772282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.788322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.789777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:33.808115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:33.809072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:33.809965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:33.809965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:33.809965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:33.809965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:33.809965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 300/585] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:33.810659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.817624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558746-cb31-479e-b7a7-21a6a453d9ad None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.855231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.863540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.864823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.865258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.865679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.866578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.867473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.869339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.886330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 286/586] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.887422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:33.922385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:33.932771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4dbb0-c594-4963-84c8-722ab6b45bdd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:33.969249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:33.970048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:33.970197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:33.970512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:33.971348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:33.971655 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:33.973796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:33.998137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 301/587] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:33.998137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.025489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412594c-8217-49b0-b1bc-e90c390bbc6d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.069568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.070232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.070562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.070824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.071540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:34.071898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.073532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.086429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 287/588] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:34.087339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.126831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.133243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe665af-4681-4b2f-942b-c87430a0335b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.174041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.175106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.175230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.175407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.182981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.184416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:34.200268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:34.201455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:34.202537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:34.206038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 302/589] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:34.206888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.213819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2040-5d1a-4641-b65e-3ee41f923314 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.218830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.252451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.253243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.253524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.253796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.265790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.267410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:34.291627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:34.292642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:34.293549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:34.293549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:34.293549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:34.293549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:34.293549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 288/590] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:34.294269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.345404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a921e7-9f20-4950-99aa-8fa6baef75d1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.400966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.401880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.402234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.402855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.407147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.414964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.419999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.429005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb29d-b1ca-4233-80d4-03337bdfe84d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:34.437086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:34.438122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:34.439140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:34.443131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 303/591] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:34.444055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.478042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.478742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.479109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.479290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.480122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:34.480430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.481894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.500267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 289/592] 10.222.0.74 () {56 vars in 1139 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:34.505789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.522814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.558845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a979d-21ed-4c54-a401-ac69235c1137 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.596214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572586a-c447-462b-b98d-53099775182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.597335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572586a-c447-462b-b98d-53099775182b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.597889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572586a-c447-462b-b98d-53099775182b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.598922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572586a-c447-462b-b98d-53099775182b None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.599845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572586a-c447-462b-b98d-53099775182b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:34.600364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572586a-c447-462b-b98d-53099775182b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.601925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572586a-c447-462b-b98d-53099775182b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.611383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fada-bce7-410d-858d-1aa975947bd3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.614873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 304/593] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:34.615908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572586a-c447-462b-b98d-53099775182b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.650517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.651084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.651459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.651912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.653253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:34.653719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.656271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.680250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.693035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 290/594] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:34.693698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.730386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572586a-c447-462b-b98d-53099775182b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.763570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.772738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.773800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.774290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.774662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.786972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.788552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:34.807694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:34.808842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:34.809876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:34.809876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:34.809876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:34.809876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:34.810940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 305/595] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:34.812490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.823066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ff7-5296-4e90-9863-a09483f9a997 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.862147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.863075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.864027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.864329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.872500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.874799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:34.898905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:34.901053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 291/596] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:34.902811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:34.926974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d2ad-2922-4586-aeac-72d5587da564 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:34.965438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:34.966249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:34.966564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:34.966846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:34.972139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.979774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:34.997748 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:35.000811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:35.001876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:35.003035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:35.003035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:35.003035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:35.003035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:35.005351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 306/597] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:35.006309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.021192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a351a2-e908-4fba-ae23-3ac4efc242bd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.042478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.067417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.068197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.068592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.069008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.070134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:35.070653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.072906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.095974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 292/598] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:35.096947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.122928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e6e62-ed44-40af-b675-3623d517610e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.158865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.159808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.160314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.161348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.162306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:35.162804 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.164418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.179158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 307/599] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:35.180032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.206321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef9c71-f5f8-4f78-9dac-024a2d70ee04 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.234623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.248817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.249536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.249817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.250090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.250957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:35.251264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.252692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.272107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 293/600] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:35.273043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.300152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.310896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9691-e1c1-4998-9d05-71ac25842a22 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.351244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.352420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.352920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.353408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.361817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.365215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:35.381676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:35.382683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:35.383623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:35.386146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 308/601] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:35.387344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.407164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a46cd-2343-4a27-b957-af859f638e62 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.450550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.451438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.451715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.451983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/f2be3143a237450a80f2fcb01a0c2e6e/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.468584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=f2be3143a237450a80f2fcb01a0c2e6e, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.470070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.506577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0255-9fc4-477f-b66b-2cf0e342a071 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.543242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.544823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.545329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.545816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.554677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.555532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 294/602] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:35 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/f2be3143a237450a80f2fcb01a0c2e6e/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:35.556546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.557008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-049f266d-46dd-4282-8320-3d61b9721562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:35.574047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:35.575065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:35.575955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:35.578215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 309/603] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:35.579777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913da52-9d45-4130-b4f7-e949e3a7db6f None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.580385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913da52-9d45-4130-b4f7-e949e3a7db6f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.580869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913da52-9d45-4130-b4f7-e949e3a7db6f None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.583856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 310/604] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:35.585061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913da52-9d45-4130-b4f7-e949e3a7db6f None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.600609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.608054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.685015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc883fe-b440-4651-9f65-63bf7a24ca84 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.710597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913da52-9d45-4130-b4f7-e949e3a7db6f None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.738873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.738873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.738873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.739710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.740775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:35.741086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.744761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c2834-38d6-44a5-89c6-fcb1f737184c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.761094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 295/605] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:35.762776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.763065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.763608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.764041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.765137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.765596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.765880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.766881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:35.767081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.768975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:35.784611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 311/606] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:35.786655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:35.786794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.788162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:35.870901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.883349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 296/607] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:35.884485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:35.909881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcefdb4-c4a0-4306-9e46-c2d3f498b735 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:35.910369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:35.958053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:35.959012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:35.959300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:35.959580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ec341a30b5274ebc9b12e0bdad2ed8a8/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:35.979094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=ec341a30b5274ebc9b12e0bdad2ed8a8, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:35.980535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:36.011554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343a766-7ca0-40ff-a938-417238249c3b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.049154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.050037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.050318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.050629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/11e6cdc7569b419fa70ba6524b5a4c24/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.066114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=11e6cdc7569b419fa70ba6524b5a4c24, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:36.068715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a2467-a319-459a-ba1e-7700ca6e18f1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:36.074603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 312/608] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:35 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ec341a30b5274ebc9b12e0bdad2ed8a8/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:36.074603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.163094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 297/609] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:35 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/11e6cdc7569b419fa70ba6524b5a4c24/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:36.165512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d188e-90b4-44a5-a552-1bc7272d9fad None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.165808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d188e-90b4-44a5-a552-1bc7272d9fad None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.166084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d188e-90b4-44a5-a552-1bc7272d9fad None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.171152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 298/610] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:36.178480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.178801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.179053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.217277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:36.218835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:36.223816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3265c0-2040-4e0e-a805-f93e7ae50d50 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.276716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:36.296905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.297721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.298002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.298276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.317820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:36.326084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:36.327195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:36.328661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 313/611] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:36.335474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.345081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:36.355841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 299/612] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:36.384368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.469272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6fa3-1e86-4ecd-a4fe-dfd7fba6307e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.508903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.509865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.510383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.510946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.511907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:36.512431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:36.514285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:36.516271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3bdaa-a30d-4436-a8c6-934d8a22da18 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.525548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 314/613] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:36.531383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.562388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.563355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.563648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.563921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.576898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:36.586073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:36.587094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:36.587966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:36.590728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 300/614] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:36.590861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:36.607919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.652670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5b774-b4e0-4cd7-88d0-6d1c4912abff None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.723889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:36.733005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.739786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.739786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.739786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.754606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:36.756160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:36.775052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351151b-deb4-4f1d-8f0f-fb80e02e7f24 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:36.792453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:36.793470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:36.794385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:36.794385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:36.794385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:36.794385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:36.803341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 315/615] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:36.809511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.829076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:36.829076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:36.829076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:36.829076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:36.829511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:36.829511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:36.829511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:36.837314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 301/616] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:36.846825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:36.983037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:36.994753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392046-aa65-45b0-a2f7-0b94234aee97 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.024575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e7e4-dc90-4549-821a-649cc412b54b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.045696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.046383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.048261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.048548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.049285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:37.049596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.051681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.073349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.079929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 316/617] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:37.086010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.098851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.099657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.099944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.100218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.118872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.120342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:37.146941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:37.147912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:37.148831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:37.148831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:37.148831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:37.148831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:37.151346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 302/618] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:37.156763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.282237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba60f-cc9d-4126-8e45-6f6c93b6df92 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.321855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.322726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.323008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.323274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.335017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.336446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:37.361959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:37.363015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:37.364856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:37.365417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff26d-7814-4610-9944-14242fcb76e9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.372699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 317/619] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:37.375182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.409003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.413104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.414037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.414572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.415045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.416373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:37.416892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.418723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.432991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 303/620] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:37.439714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.501259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.551492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e419c8-730c-4755-8ba9-6e590a9a22cb None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.608862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.609647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.609934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.610210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.611081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:37.611399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.612896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.634198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 318/621] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:37.636568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9445bf-84a8-41e6-9083-6c60c0abb016 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.642946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.673328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.674129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.674437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.674714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.688438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.689921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:37.712481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:37.713469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:37.714427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 304/622] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:37.723925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.769361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.796413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2122fa-4c34-43cb-b443-a9922e0a4278 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.833222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.834364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.834878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.835370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.846001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.847828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:37.879388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:37.880369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:37.881263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:37.881263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:37.881263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:37.881263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:37.891506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 319/623] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:37.908209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:37.942440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf32de-d28d-4eff-a705-bcadef31575d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:37.943149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.970889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:37.971655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:37.972014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:37.972385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:37.973867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:37.974317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:37.976539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:37.993870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 305/624] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:37.999392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.081726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab4e3-2965-4038-bcc4-d898015d51bb None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.108753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.117907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.123437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4490349-b863-4a4f-b158-f1df4ef94615 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.134655 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 320/625] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:38.135966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83050ab-c10c-45a6-801a-1a232370258c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.136257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83050ab-c10c-45a6-801a-1a232370258c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.136536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83050ab-c10c-45a6-801a-1a232370258c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.137982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 321/626] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:38.143298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83050ab-c10c-45a6-801a-1a232370258c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.158868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5322-a75e-4b8d-b431-dcb4db04a8c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.211497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.212511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.213025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.213719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.243413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.254260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83050ab-c10c-45a6-801a-1a232370258c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.291157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.292096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.292378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.292651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.298683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.299923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.300216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.302759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-6b32c40b-4205-472f-b8ae-cd10e397af38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:38.319244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:38.320216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:38.321632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 322/627] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:38.322148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.322441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.322671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.342539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:38.343727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:38.392693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.416380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 306/628] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:38.417254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.425410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 323/629] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:38.427082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.479496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.530703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be5ee-71e8-499f-89f9-3f18c2b92940 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.571988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87502bd9-1826-46ea-a4b2-95606ba4c2f1 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.579698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.581195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.581707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.582749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.584193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:38.585139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.587196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.604932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 307/630] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:38.606754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.612448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.613289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.614218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.614520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.629839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.631656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:38.661702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:38.662687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 324/631] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:38.663605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.696288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.732259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed9ae-45b4-41df-92d9-f0b112972ccd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.747804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:38.769127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.770052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.770334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.770652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.778249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0049-0f6f-4ba5-8dcf-8b0ca7d175ae None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.782150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:38.790598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:38.791722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:38.792761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:38.795229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 308/632] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:38.796280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.819084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.819983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.820272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.820553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/29d1b699dac04f23bf3e2f6cd54d33a4/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.835401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=29d1b699dac04f23bf3e2f6cd54d33a4, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.836847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9764e6-6a32-4652-b76a-a1cf052b16e2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.900713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9861bd-094f-4df9-a4c4-63fddd4f8694 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:38.902228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 325/633] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:38 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/29d1b699dac04f23bf3e2f6cd54d33a4/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:38.906985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e46e-f35c-4636-857e-5b9831f52c9c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.907288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e46e-f35c-4636-857e-5b9831f52c9c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.908006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e46e-f35c-4636-857e-5b9831f52c9c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.908889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 326/634] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:38.909671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90e46e-f35c-4636-857e-5b9831f52c9c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:38.945978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:38.946880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.947168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.947451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.948189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:38.948499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:38.949928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3aaf2-65fb-492b-a751-d35956533c9d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:38.967680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 309/635] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:38.967680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b45a-cf89-4767-b46f-4f7b300288a0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.967680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b45a-cf89-4767-b46f-4f7b300288a0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.967680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b45a-cf89-4767-b46f-4f7b300288a0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.967680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 310/636] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:38.968486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:38.968739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:38.969029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:38.990673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:38.991918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:39.017316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.022614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.042762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90e46e-f35c-4636-857e-5b9831f52c9c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.068310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 311/637] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:39.069548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.097349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.098067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.098351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.099278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.099599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.099937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.101366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c1b63-c9e6-4026-afb0-080856c77b31 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.114592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 327/638] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.116350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.116648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.116923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.133986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:39.135199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:39.185462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792c32c-1183-4222-a98f-367cbd3cf679 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.205734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 328/639] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:39.206561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.225382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.226588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.227094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.227577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.235048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.236488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:39.250571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:39.251727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 312/640] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:39.254704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.281359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.294227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.332882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d57a3-aacf-40e8-bf9e-e3aea91d10f0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.364516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5370df-c6fa-4d35-ba65-7bc8513b2561 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.370917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.371729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.372017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.372298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.384207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:39.392638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:39.393576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 329/641] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:39.395343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.410128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.411295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.411575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.411857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.422243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.423711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:39.442168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:39.443281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 313/642] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:39.444794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.517274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b62754-7c0d-4fdd-8a6c-7c76afd317ec None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.525704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.548247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.553113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061d34a-f095-46d0-a99d-63f41f2c5f53 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.554242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.555077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.555365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.556046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.566572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:39.574695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:39.575641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:39.576547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 330/643] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:39.577265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.595716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.596390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.596674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.596948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.598556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.598880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.600320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.612809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 314/644] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.618187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.683188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642310e-00ba-4beb-85ab-00bbe350ba5f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.718529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.719221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.719509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.719785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.720543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.720835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.722222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.724503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75de93-02a5-4230-9e03-2b7d9e7f9ca3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.735570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 331/645] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.735570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.765513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.766171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.766478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.766755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.767516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.767769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.769336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.771409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.787351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 315/646] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.787351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.791951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:39.842946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40713203-7202-4063-a729-d6423cd48c50 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.880079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.880839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.881122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.881402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.882135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.882462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.883880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.891065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e220e-6a31-4556-84ff-60e44dcfc680 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:39.892889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 332/647] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.894280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:39.940846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:39.942090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:39.942468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:39.942752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:39.943706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:39.944022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:39.945467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:39.951976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 316/648] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:39.952691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.021654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.029886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b83-6daa-44ae-a80b-29b40a80039f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.047542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.070406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5112bd-42db-4058-9a8f-6a0aaac71e3b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.071048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.072137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.072618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.073089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.086611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.088528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:40.109205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:40.110163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:40.111092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:40.111092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:40.111092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:40.111092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:40.113527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 333/649] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:40.115210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.115809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.116845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.117224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.117598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.126980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.128898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:40.149946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:40.151194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:01:40.152362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:40.154535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 317/650] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:40.155935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.236781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f2f4-7dd0-4cb7-9e3c-2543338fdcce None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.277899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.279042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.279470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.279910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.282232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed528-af45-4b62-9b0c-6a4b7eef8e23 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.292281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.294067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.304214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:40.313890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:40.314975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:40.316169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:40.316169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:40.316169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:40.316169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:40.318762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 334/651] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:40.319592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.325017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.325935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.326712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.327172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.329013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:40.329528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.331169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.345276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.349592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 318/652] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:40.350769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.454132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0821-ccd8-4025-856a-c8a2dbdfdf43 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.480905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a743-60b3-4a98-9e9a-dd5998e9d890 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.494142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.494841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.495125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.495400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.496226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:40.496778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.498014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.517020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 335/653] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:40.517889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.530754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.531886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.532330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.532782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.534390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:40.534897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.537979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.555491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 319/654] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:40.556686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.607091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.622792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.631720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace821cb-1de4-41f0-bdf1-e12f3fb24c81 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.668864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.669817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.670200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.670619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.679028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.680785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.695648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5951b-9b3f-4500-af73-797fa3e66b68 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:40.696800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:40.698291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 15:01:40.699539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:40.705488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 336/655] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:40.706509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.745527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.746959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.750721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.751674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.821927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff037db-bcab-4060-938b-30bd83a49bc8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:40.839831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.841486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.867772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:40.869136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:40.869731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:40.870166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:40.874616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.882360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:40.889238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:40.889238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:40.906274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:40.907710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 15:01:40.908871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:40.913411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 337/656] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:40.914508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:40.958225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 320/657] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:40.959287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.054189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94600ea8-073e-4126-81f7-d50166627708 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.083506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc4-8475-4307-a11b-b746e6d5f5ca None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.091313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.092247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.092717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.093502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.094859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:41.095508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.097416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.123763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 338/658] 10.222.0.74 () {56 vars in 1139 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:41.124756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.124869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.125835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.126329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.126814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.128117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:41.129950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.131711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.143789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.157030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 321/659] 10.222.0.74 () {56 vars in 1137 bytes} [Fri May 27 15:01:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:41.158146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.190213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.238921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4e27-d6a0-4d74-9e22-1cfb3c56de1d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.264397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821feb-8518-40a9-be15-e1f76f7d7334 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.277192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.277993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.278268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.278580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.289128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.290709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.307153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.308376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-41512491-34ae-497c-894f-24e0d74f636e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:41.308771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:41.309677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:41.310662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:41.310662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:41.310662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.310662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:41.310662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 339/660] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:41.311244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3fb1-9eb2-462c-b63f-ef8c6f7a9f35 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.311560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3fb1-9eb2-462c-b63f-ef8c6f7a9f35 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.311794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.311903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3fb1-9eb2-462c-b63f-ef8c6f7a9f35 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.312555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.317611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 340/661] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:41.317611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3fb1-9eb2-462c-b63f-ef8c6f7a9f35 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.383013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.390298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.393839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.423955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3fb1-9eb2-462c-b63f-ef8c6f7a9f35 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.433146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.461893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.462887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.463173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.463449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.495042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 322/662] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:41.499982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.538018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.539523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a395e72-d4bb-4fbd-945c-da7b1fa2b799 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.600023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.606491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326b3a-14b4-42f3-b5a3-a1263f5e6a6a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.643585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.644166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.649085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.649219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 341/663] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:41.649324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.649324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:41.649324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.649514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.649514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.649514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.649720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.659672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.661633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 323/664] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:41.662288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.671193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:41.672378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:41.743746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 342/665] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:41.745697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.770181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcbb6-5da1-402f-92b6-6ee630bceeed None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.805369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.806542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.806989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.807270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.819493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.821061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:41.839471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:41.840406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:41.841315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:41.841315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:41.841315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.841315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:41.841315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 324/666] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:41.841605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.856315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.878747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400a4d-15b8-4d2c-b8f4-2e50e1042a0b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.922354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.923277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.923628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.923970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:41.927409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:41.935212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:41.938384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:41.950754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23ab0-6563-4b3e-a47e-6fa9112e45e0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:41.954496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:41.955383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 343/667] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:41.961221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:41.995467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:41.996375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:41.997410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:41.997410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.003912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.005517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:42.021130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:42.022072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 325/668] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:42.023463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.072206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e795-4a63-40d8-a3d3-580294e9e7ba None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.112044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.124632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.125699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.125699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.126024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.137693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:42.146517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:42.147490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:42.148358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:42.149005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf8dd2-274f-479a-96f7-de37c2460f38 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.152596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 344/669] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:42.153438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.217324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.279497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180859d-f0af-41c3-94b9-2fb281b27d98 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.309885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.310674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.310974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.311255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.311984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.312283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.313695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.320150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.321036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.321508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.321787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.322529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.322838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.324187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.326742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 326/670] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.327363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.342077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 345/671] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.343127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.438537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e221c-0ead-4bf9-81f4-a1084c7968d4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.447485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113171c5-7285-4f67-a16e-6896623aea91 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.456704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.466139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.474825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.475501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.475788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.476064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.476844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.477156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.478610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.486516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.486516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.486516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.486516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.486862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.486862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.486862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.491161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 327/672] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.491969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.496075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 346/673] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.496075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.593785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c673fe-5cbd-4079-a9b4-d091ebec55a1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.597587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256cdec-b035-4fa0-b79c-10713090b663 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.628728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.630135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.630443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.630731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.631859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.632646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.632931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.633211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.637418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.641849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.642110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.642110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-141a83bf-e193-4a57-958f-268c8ed07ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:42.653554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:42.654458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:42.655380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 328/674] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:42.655872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:42.656673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:42.657596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:42.658036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa513a4-e47e-49c7-8495-e5570c368981 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.658036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa513a4-e47e-49c7-8495-e5570c368981 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.658036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa513a4-e47e-49c7-8495-e5570c368981 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.658225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 347/675] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:42.658225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.660578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 329/676] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:42.661517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa513a4-e47e-49c7-8495-e5570c368981 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.688801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.713283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.757210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409174-04de-4ab7-90a7-1bdb36c4a612 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.765010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa513a4-e47e-49c7-8495-e5570c368981 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.791815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.792471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.792762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.793037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.793914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=f2be3143a237450a80f2fcb01a0c2e6e) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.794248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.795702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.798635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.799078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.799361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.799636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.801676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 348/677] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/role_assignments?user.id=f2be3143a237450a80f2fcb01a0c2e6e&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.802478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.811131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.812613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:42.833472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:42.834522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:42.835459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:42.835459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:42.835459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:42.835459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:42.835459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 330/678] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:42.835737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:42.919740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.927438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd55c79-c349-48d4-96eb-8bc19b6ad7f6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.964903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:42.967442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:42.967751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89210df2-be2e-4cfb-8123-0ab2f64534e9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:42.968129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.968413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.968693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:42.969613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:42.969799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:42.971304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001f4a-e576-485f-aecb-7fcf703b3fea None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:42.989941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 349/679] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:42.989941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:42.989941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:42.989941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.004688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:43.005866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:43.014356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.015053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.015336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.016408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.017202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.017513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.018969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.031928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 331/680] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:43.033389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.080329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 350/681] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:43.081178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.150502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440024-2bb7-4380-af33-f0082f32367e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.175187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.185850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.186784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.187219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.187645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.188511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.188997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.190573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.193220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412fc7c-8783-431c-86ad-6c288b59e477 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.208179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 332/682] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:43.208179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.230809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.233780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.234529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.234823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.235109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.236062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ec341a30b5274ebc9b12e0bdad2ed8a8) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.236378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.237821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.245011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 351/683] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/role_assignments?user.id=ec341a30b5274ebc9b12e0bdad2ed8a8&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:43.245822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.330094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c4f5-c7db-42b7-89c2-f48abba84578 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.374657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776008-41fa-47ea-a859-755b1e2e2169 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.383794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.384567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.385330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.385330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.386236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=11e6cdc7569b419fa70ba6524b5a4c24) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.386664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.388351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.402982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 333/684] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/role_assignments?user.id=11e6cdc7569b419fa70ba6524b5a4c24&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:43.404403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.424812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.426156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.426866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.427343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.445951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:43.454032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:43.455135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:43.456019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 352/685] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:43.461919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.480380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.547935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.566972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0029e6-dd5a-4b5e-a56f-a0bbe9891b63 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.597746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbc4-1bda-4430-89d4-b230c625c4a7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.607685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.608491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.608769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.609042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.618163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.619664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.639666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.640671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.641142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.641602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.642567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:43.643057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:43.647878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:43.648900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:43.649440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.649523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 334/686] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:43.649593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.651880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.664889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 353/687] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:43.671772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.770782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.797540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8678f-775a-43f7-b44e-8932a674114f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.802790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae245a-ee84-44ab-85ee-6f69405e7c4c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:43.836684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.837362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.837646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.837923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.838793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:43.839107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.840589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.841210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:43.842103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:43.842391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:43.842761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:43.854891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:43.856268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:43.860798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 335/688] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:43.868426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:43.872208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:43.876767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:43.877650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:43.879570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:43.879570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:43.879570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:43.879570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:43.879570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 354/689] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:43.883936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.056551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b463-1eb7-47a0-a309-712cbe09ed69 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.085164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98e8f-73a9-4409-a4d5-fe6843afe75d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.102483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.103154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.103432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.103703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.142863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:44.157859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.158569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.162386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.162386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.163268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:44.163599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:44.165162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:44.194293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 355/690] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:44.200322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.240826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:44.242304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:44.244395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:44.385255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cde3a-7915-4a72-a3e9-21d42b2087c7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.410991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 336/691] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 15:01:44.415338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.421127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.421928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.422215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.422519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.431222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:44.432655 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:44.448570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:44.449618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:44.451206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 356/692] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:44.455403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.501196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:44.565265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8b1bd-4177-448a-851e-56cb901be223 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.604619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5adec-cd49-44af-a2ea-700e76017417 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.606246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:44.611348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.612030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.612310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.612586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.614293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:44.620041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:44.620041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:44.637320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 357/693] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:44.643173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.678292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.683672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.684286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.684806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.712983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:44.715782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:44.750636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:44.751591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:44.752505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:44.752505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:44.752505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:44.752505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:44.761639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 337/694] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:44.762605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:44.802799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:44.807741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440f4e7-f403-4051-926f-b7055547eef5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:44.878057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:44.878736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:44.879246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:44.879538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:44.970125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd8eb-c73f-4c76-a3a3-8d6c4f7279c9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.016245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.017696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.051858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.052536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.052821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.053102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.053840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:45.054153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.055562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.077730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 338/695] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:45.083836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.116555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.168264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.173620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 358/696] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:45.179242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.226150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e050-8ea9-44d7-a9c9-79392c1a04d0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.266254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.267397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.267894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.268352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.278080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.279943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:45.297782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:45.298799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:45.299712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:45.303735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 339/697] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:45.309569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.392994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.409086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42172fcd-b13c-46fb-b8a9-e3870a47b3f3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.421404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3bb92-b901-40fd-9353-c77878d9a1f1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.462660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.463814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.464410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.464869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.465840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:45.466478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.468444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.484685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 340/698] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:45.491716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.494910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.495800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.496174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.496523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.509044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.510643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-d23f0158-ecce-42eb-afed-cfe060e8fdc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:45.529291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:45.530315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:45.531269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:45.531269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:45.531269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:45.531269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:45.531269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 359/699] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:45.532714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717819-4777-4e9b-b12d-d7f932216269 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.533102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717819-4777-4e9b-b12d-d7f932216269 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.533475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717819-4777-4e9b-b12d-d7f932216269 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.539973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 360/700] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:45.541401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15717819-4777-4e9b-b12d-d7f932216269 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.599573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.631053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbead3-75b8-4263-9ed1-6e7ecd4dc4c4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.652606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15717819-4777-4e9b-b12d-d7f932216269 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.671726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.672747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.673300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.673778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.674844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=29d1b699dac04f23bf3e2f6cd54d33a4) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:45.675378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.678438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4ef25-8e64-4d67-aca4-427d1de9a537 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.680830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.686576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 341/701] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/role_assignments?user.id=29d1b699dac04f23bf3e2f6cd54d33a4&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:45.688211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.694398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.694398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.696837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.698073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.698073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.698073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.698824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:45.699144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.700595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.712180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:45.713826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:45.727900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 361/702] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:45.733098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.797962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 342/703] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:45.849284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:45.883838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40019eb-0a05-4c59-9252-6c4adc6ffe92 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:45.909646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:45.928520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:45.930629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.930629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.930629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.943716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:45.944856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4b22800d-8741-4932-af55-0e7086502887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:45.965410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:45.966617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:45.967564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:45.970623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 362/704] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:45.977861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca559-abc6-42d2-b410-9208f59cf605 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:45.978147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca559-abc6-42d2-b410-9208f59cf605 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:45.978440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca559-abc6-42d2-b410-9208f59cf605 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:45.982704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 363/705] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:45.983526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ca559-abc6-42d2-b410-9208f59cf605 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.096480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795beff8-cdcd-4773-8b2b-abc9a5346e8f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.147683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:46.161489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ca559-abc6-42d2-b410-9208f59cf605 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.161686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.162226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.162575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.164652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.165357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.167057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5965846b-5599-431e-bdfe-08088b6102ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:46.186017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:46.187133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:46.188026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 343/706] 10.222.0.74 () {56 vars in 1129 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:46.188880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.189549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.189549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.209798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.210948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.210948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.211149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.213194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:46.213194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.213750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.218860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:46.220409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:46.237607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 364/707] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:46.238612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.290842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:46.309664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 344/708] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:46.310929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.385365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c957-7b5f-4168-9c58-30277687e716 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.421093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.421766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.422061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.422350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.423068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:46.423375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.424735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959e88-6aec-47b5-9a9b-ce00912ea021 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.430396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 365/709] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:46.431516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46addd-645c-40f0-9653-8d51f25aeb97 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.431807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46addd-645c-40f0-9653-8d51f25aeb97 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.432086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46addd-645c-40f0-9653-8d51f25aeb97 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.433462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 366/710] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:46.434020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46addd-645c-40f0-9653-8d51f25aeb97 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.440032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17717a2a-1ef8-49be-a9b1-4850f7fc7436 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.464815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:46.477270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.477929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.478214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.478521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.479356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:46.479667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.481117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.487029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 345/711] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:46.488058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.575758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:46.587405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46addd-645c-40f0-9653-8d51f25aeb97 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.623900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba373-472a-466f-8e0d-5ffc3f65959c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.628308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.628621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.628861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.630808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] PATH_INFO: `/v3/services/network` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.631526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.632954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-209bfdff-0967-419a-a733-09108832ac0f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:46.650426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:46.651596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:46.652453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 367/712] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:46.653348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.653348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.653348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.673018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:46.674229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:46.677506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.679059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.679345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.679626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.680402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:46.684833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.684833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.690617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 346/713] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:46.691533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.753913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:46.770048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 368/714] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:46.810918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60ff82-4ba4-4595-9568-4b7f0ce4c59e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:46.819925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:46.849206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:46.849938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:46.850227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:46.850659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:46.851355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] RBAC: Adding query filter params (name=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:46.851663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:46.858442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:46.858668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 347/715] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:46.869866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:47.019247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41e6be-d4d1-4ce0-8969-e17320059d53 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:47.037086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:47.069776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:47.075732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:47.087037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 348/716] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:47.087198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8495aa-3cf2-45b7-a39d-db3a644bfd13 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:47.094744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:47.124640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:47.125580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:47.125995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:47.126371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:47.138374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:47.140544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:47.160012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:47.161528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:47.162583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:47.162583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:47.162583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:47.162583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:47.162583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 369/717] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:47.167792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:47.338086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb54bf-33f1-4a61-b399-d0b885d062f6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:47.374852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:47.375530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:47.375815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:47.376089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:47.376811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:47.377116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:47.380648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87656b-73c2-4203-b593-5f0264844ef4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:47.399970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 349/718] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:47.405428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:47.512183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171417f6-7938-4180-a953-a785d9c87498 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:47.547749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:47.548433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:47.548719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:47.548996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:47.549702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:47.551211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06830ce6-ca30-496c-ab7a-698fa3536e56 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:47.674958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:47.681080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 370/719] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:01:47 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:48.544681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986bf4a-ce80-4eee-baad-51b27d732b56 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:48.545712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986bf4a-ce80-4eee-baad-51b27d732b56 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:48.546199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986bf4a-ce80-4eee-baad-51b27d732b56 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:48.548048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 350/720] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:48.554330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:48.555212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:48.555713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:48.579385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:48.581028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:48.676865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 371/721] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:48.718186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986bf4a-ce80-4eee-baad-51b27d732b56 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:48.777358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:48.852150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986bf4a-ce80-4eee-baad-51b27d732b56 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:48.897960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:48.899151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:48.899634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:48.900120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:48.923779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:48.931561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:48.932527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:48.933372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 351/722] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:48.940398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.090529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e02784-b2c2-4131-a50c-b2fd79ce381f None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.137525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:49.148071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:49.148761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.149047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.149329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.150091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:49.150466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:49.151857 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb730073-4995-4673-b554-78dbfe5bf88d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:49.166845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 372/723] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:49.172105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.281498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01bb59-4e27-4566-9dac-4d913dd77746 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.281824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01bb59-4e27-4566-9dac-4d913dd77746 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.282059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01bb59-4e27-4566-9dac-4d913dd77746 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.283719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 373/724] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:49.289464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.289753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.290034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.316312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:49.318440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:49.318883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:49.323647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af77-140f-4839-98b4-94518c00f0d3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.365052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:49.365849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.366130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.366403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.377646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:49.379842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d5ca3ef8-0910-42ac-a19a-b8478f45d756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:49.399006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:49.400036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:49.400962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:49.400962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:49.400962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:49.400962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:49.400962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 352/725] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:49.402031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 374/726] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:49.402172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bc3-0606-4029-b3cd-10d1d5fdba7e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.402172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bc3-0606-4029-b3cd-10d1d5fdba7e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.402458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bc3-0606-4029-b3cd-10d1d5fdba7e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.407513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.408201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 353/727] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:49.416040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.416331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.416609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.445175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:49.446516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:49.524250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 354/728] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 15:01:49.525088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.532214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35b422-61e4-49b8-b3c5-a5423df8b174 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.561895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:49.576536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:49.577461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.577753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.578035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.579262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:49.579579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:49.581252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:49.596023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 375/729] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:49.598310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.632167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:49.665714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4243d-e3f7-4a06-84c6-e69e3b4eb797 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.714675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:49.715357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.715640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.715927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.716900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:49.719039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:49.723785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd857d-14f6-4ad3-a2cf-2a56270088f3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.760673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:49.761565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:49.761846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:49.762115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:49.774282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:49.782116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:49.783097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:49.784037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 376/730] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:49.784749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.838533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 355/731] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:01:49 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:49.839544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:49.857688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:49.945091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dac8bd-1a72-4ee1-acc6-a64e9c3b3f4d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.986320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15270-9112-4727-9f44-da4a79cf5c82 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:49.999378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.000503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.000959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.001932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.022559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.022559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.034985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.035872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.036260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.036642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.037510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:50.037928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7de507c0-aec5-4e5c-8362-7bed9f26322e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:50.038708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:50.039828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:50.041000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 377/732] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:50.043809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215e53-695d-4c3f-8e90-d1a3aafe151d None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.043809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215e53-695d-4c3f-8e90-d1a3aafe151d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.043809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215e53-695d-4c3f-8e90-d1a3aafe151d None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.043809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 378/733] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:50.045571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3865100-8034-4b3c-9645-f638a1c7b30e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.048699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.049678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215e53-695d-4c3f-8e90-d1a3aafe151d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.059067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 356/734] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:50.060673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.060979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.061301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.080234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:50.081586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:50.162620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 357/735] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 15:01:50.163642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.176412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.192584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215e53-695d-4c3f-8e90-d1a3aafe151d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.242233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.242914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.243729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.244010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.244852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:50.245164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.247555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.270957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 379/736] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:50.273024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d4b36-cc0d-4a63-87ae-5075af6c3a96 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.276409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.303020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.316074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.317408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.317859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.318277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.332460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.334953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:50.360630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:50.361756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:50.362976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:50.362976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:50.362976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:50.362976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:50.365434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 358/737] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:50.366489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.395008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526b70-453b-4de8-a4f8-4213836072a2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.444379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.445588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.446020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.446495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.447364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.449729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.485405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07298ff-2c26-412d-b35b-8724ec7bd443 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.527391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.528400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.528914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.529340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.534900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 380/738] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:01:50 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:50.536574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.580252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.597318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.624930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.627852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.755934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 359/739] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 15:01:50.764746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.817464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862a47-683f-442c-9cff-aa5bfaa181e3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.871993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.873175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.874494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.875020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.875968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:50.876501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.878075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a1d0a-4155-4ede-aa23-b92b0f2d8f35 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.886761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.892882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 381/740] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:50.894301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49c709-1c33-40fb-a660-462dabcb13c9 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.895272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49c709-1c33-40fb-a660-462dabcb13c9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.895633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49c709-1c33-40fb-a660-462dabcb13c9 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.896946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 382/741] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:50.901950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49c709-1c33-40fb-a660-462dabcb13c9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:50.922135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bd37f-aada-45d9-9fcc-21b0a9bd91c9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:50.960941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:50.961853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:50.962151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:50.962449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:50.973948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:50.975715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:50.981117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9c5b201e-824c-4312-bcd8-884809a18278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:50.995308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:50.997052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:50.997995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:50.997995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:50.997995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:50.997995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:50.999611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 360/742] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:51.001048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.001523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.002036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.010300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49c709-1c33-40fb-a660-462dabcb13c9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.020967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:51.022481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:51.047376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.048173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.048462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.048744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.057475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.058906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:51.073698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:51.074745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:51.075708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 383/743] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:51.076303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.102672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 361/744] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:51.103810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.171502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.213124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c972-9ddd-44dc-a193-9245f231b329 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.214344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee28b-807f-4ff8-8a05-09dc8c77d619 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.252344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.253172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.253561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.253756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.254157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.255000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.255149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.255561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.255738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.256158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.257135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.257251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.257704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.259015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.260637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.271632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 384/745] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.272666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.280738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 362/746] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.281818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.387376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00caf-6eae-4a1a-af95-4e84eeb0a740 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.392011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f83eb-467c-43ce-aa36-fcb5e091d03b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.415350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.426809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.431168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.431168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.431168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.431389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.431931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.432175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.432409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.439880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.440908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:51.441371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:51.453477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:51.455019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:51.455992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:51.456637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:51.459166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 363/747] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:51.461302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.469634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 385/748] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:51.471151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.532578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.568483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85633082-a264-46c1-8434-eb9a4d6ef719 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.582918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2aacb-5a8f-47c4-abc1-85b41d91691c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.606538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.607343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.607635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.607920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.617642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.618306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.618635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.619064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.619846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.620155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.621044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.621588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.622677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.635481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 386/749] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.636378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:51.644023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:51.645498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:51.646606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:51.646606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:51.646606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:51.646606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:51.646606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 364/750] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:51.647474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.684208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.744188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ec13-b2ff-4db1-9ea9-e8e469545db6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.759179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.762395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92810dc-3cdd-4c23-a581-b110a00aa7c8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.784485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.786055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.786394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.787018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.787555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.787868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.789284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.798525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 387/751] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.799525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.804810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.805668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.806131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.806583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.807584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=29d1b699dac04f23bf3e2f6cd54d33a4) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.808049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.809734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.816834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 365/752] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/role_assignments?user.id=29d1b699dac04f23bf3e2f6cd54d33a4&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.817919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.910887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe633f-b1e7-4a0a-8649-bd0399a49e37 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.943673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.948150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.948842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.949123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.949710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:51.950128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:51.950516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:51.954549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:51.954667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfea6-ac5a-44f7-af79-58cdaecea927 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:51.969270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 388/753] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:51.970702 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:51.992748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:51.994057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:51.994711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:51.995145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.008458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.010320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.020003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:52.047931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:52.049131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:52.050276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:52.050276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:52.050276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:52.050276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:52.052119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 366/754] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:52.057966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.093046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7556d16-ae3d-4b9d-99ee-59fba753deff None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.130400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.131321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.132132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.132132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.140948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.142388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:52.158580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:52.159735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:52.160989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:52.164530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 389/755] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:52.165954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.181602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248facf-c4e1-4fc8-975e-3d2876101b3e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.265819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.266880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.267335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.267761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.274848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:52.275612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:52.276623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.278211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.285792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf5c4-d075-4bc1-8989-24413c3e7829 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.309138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 367/756] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:52.314566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.334109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.335111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.335396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.335671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.336471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:52.336779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.338253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.350771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:52.369204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 390/757] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:52.383184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.526183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484d63-68e0-4437-b4f2-0751725c833e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.558151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc6945-3c60-49aa-9d55-6910d55cb32c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.564317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.565325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.565761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.566310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.575502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.577271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5b0436fc-4ab8-4847-9ddc-986dad5d3a98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:52.593934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:52.595061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:01:52.596009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:52.596551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 368/758] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:52.597463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceabfa-73a3-4e5e-80a9-8182257d86a8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.598294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceabfa-73a3-4e5e-80a9-8182257d86a8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.598587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceabfa-73a3-4e5e-80a9-8182257d86a8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.604045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 369/759] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:52.604045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceabfa-73a3-4e5e-80a9-8182257d86a8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.604624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.605513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.605788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.606057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.608083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=4af65d40347141eebeb01eb446f93766, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.609734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4e67-8311-4749-aacb-1d22d6348bfe None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.678837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:52.696480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 391/760] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:52 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:01:52.696480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.696480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.696828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.732554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:52.733813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:52.743755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceabfa-73a3-4e5e-80a9-8182257d86a8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:52.761757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:52.825612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:52.826353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:52.826627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:52.826878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:52.827760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:52.828073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:52.829892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:52.861505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 392/761] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:52.865575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 370/762] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:52.870959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:52.937980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.032954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127269a1-ae86-4633-b4d0-4721d651c594 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.064239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bbd9b-0d83-485b-b10c-55c4bd5c031e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.075049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.075765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.076001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.076284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.096309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.098995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.106831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.115018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.115018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.115018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.115018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.115018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-314a38ca-bfb9-4278-8b9d-5e2d7ff0c699 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:53.125749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:53.126842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:53.127729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.132646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 371/763] 10.222.0.74 () {56 vars in 1129 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:53.134257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb85f3-7c2e-4e20-b24b-2ffc329046cd None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.134790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb85f3-7c2e-4e20-b24b-2ffc329046cd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.135282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb85f3-7c2e-4e20-b24b-2ffc329046cd None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.137895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 372/764] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:53.139133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb85f3-7c2e-4e20-b24b-2ffc329046cd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.174118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.176860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5f0b-b59a-4fa0-92af-09987879fda2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.270463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb85f3-7c2e-4e20-b24b-2ffc329046cd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.308651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 393/765] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:01:53.309981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.310279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.310591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.313899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.314902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.315721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.317607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.318831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:53.319385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.321065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.330347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:53.331577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:53.331842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 373/766] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:53.333412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.388074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.396218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.416500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 394/767] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:53.418115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.458607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d76a2-9337-4cf5-a941-b7ee21efe3cf None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.505169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.506619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.506914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.507475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.522581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.524636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.541100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f7c64-32ec-4585-a7ea-0d2ec43c2f7d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:53.548272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:53.549251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:53.550150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:53.550150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:53.550150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:53.550150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.552795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 374/768] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:53.552795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.589695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.590684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.590990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.591724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.592724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:53.593041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.594708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.604217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 395/769] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:53.605472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.664805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.677179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e426fa-a306-43cc-9534-38989a08ea08 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.685265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.713929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.714768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.715051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.715330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] PATH_INFO: `/v3/services/network` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.716160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.718060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:53.730205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:53.731269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:53.732121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:53.736705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 375/770] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:53.737648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.754931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03dda-5b49-4c22-9432-c0c602b4a298 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.801995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.803177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.803468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.803750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.804477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:53.804789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.806198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.823867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 396/771] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:53.824771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.860813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa587fe6-c087-4692-9fc4-c759c7c3c92e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.918196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.918899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.919183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.919460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.920314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] RBAC: Adding query filter params (interface=public, service_id=30bed7aa96d14c74b92b9bef75eb6e0a, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:53.920632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.922787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.933747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 376/772] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/endpoints?service_id=30bed7aa96d14c74b92b9bef75eb6e0a&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:53.934858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:53.939302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.943062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10c41-789a-445c-9959-80c94d57b6d9 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:53.978984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:53.980017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:53.980153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.980672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:53.981161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:53.982074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] RBAC: Adding query filter params (name=network) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:53.982662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:53.984305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:53.994801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 397/773] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:53.996105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.052344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040534ca-63ee-44f9-a429-88fb5b9836e7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.090646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.091465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.091745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.092017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.100693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.102216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.110961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c416f38-2d26-4948-9000-03937fa5c542 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:54.117153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:54.118091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:54.119060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:54.126437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 377/774] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:54.126437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.158955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.159925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.161063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.161500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.162342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.163972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.178756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 398/775] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:01:53 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.180030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.226825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:54.234079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:54.242841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9260-241c-4195-be0e-da3dc7722da0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.281322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.282257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.282740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.283165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.284044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:54.284501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.287179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a92f-a0bf-4a44-8d51-b0574f00c5a8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.293133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 378/776] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.294887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001c72-c35b-46bc-8f1a-5ac8d85cfeb8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.295340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001c72-c35b-46bc-8f1a-5ac8d85cfeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.295791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001c72-c35b-46bc-8f1a-5ac8d85cfeb8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.297679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 379/777] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:54.300561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e001c72-c35b-46bc-8f1a-5ac8d85cfeb8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.326546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db177c3-c448-4a39-af07-dc0675bf3c1b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.366037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.366665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.366954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.367235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.368040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:54.368362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.369827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061902-6cd6-4581-a704-784ab0c98091 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.383973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 399/778] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.385481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.385781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.386066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.405138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:54.406581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:54.423522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e001c72-c35b-46bc-8f1a-5ac8d85cfeb8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.466096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.466820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.467102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.467377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.468170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] RBAC: Adding query filter params (interface=public, service_id=603028cec47a42dd8219278ff4a592c7, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:54.468484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.469855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.478263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 380/779] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/endpoints?service_id=603028cec47a42dd8219278ff4a592c7&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.479244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.490508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 400/780] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:54.491995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.512381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:54.526563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:54.611726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f461-95b7-4aa2-88f1-1244f4091f1e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.617872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f970e9-4037-4d03-90ea-309081ed8d89 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.656153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.656814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.657102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.657380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.658431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=580d7a05a3cd412db56c0478b5b3842d) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:54.658778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.659751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.660671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.660918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.661151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.661539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.662337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:54.664524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:54.670501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 381/781] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/role_assignments?user.id=580d7a05a3cd412db56c0478b5b3842d&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.675229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.678338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 401/782] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:54.779835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:54.797038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c639d-8fc3-42d1-a3e5-eb9a2ec469f7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:54.835399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:54.836242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:54.836601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:54.836780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:54.851085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:54.859280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:54.860319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:54.861899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 382/783] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:54.871076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:54.981948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:55.000822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a3eaa-e0eb-44ee-b9c1-57d59bdefa31 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.038361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.039067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.039352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.039630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.040379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:55.040687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:55.042075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f9105-a184-4cbe-b4a3-33502eedcab9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:55.052502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 402/784] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:55.058479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.188057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3342-324c-4b42-b331-7582325a6456 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.240048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.240862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.241147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.241425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.250745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7288460-2fbb-4e9c-9c4f-37a1f9a0504e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.251055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7288460-2fbb-4e9c-9c4f-37a1f9a0504e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.251314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7288460-2fbb-4e9c-9c4f-37a1f9a0504e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.252927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 403/785] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:55.259181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:55.260787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:55.263708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.264259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.264538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.282465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:55.289181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:55.290392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:55.302043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:55.303921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:55.304834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:55.304834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:55.304834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:55.304834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:55.308385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 383/786] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:55.317087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.433341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 404/787] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:55.452020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5939a1-7a6a-4d6f-9de6-b483b5a62d53 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.478589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.493768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.494687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.495130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.495531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.496376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:55.496817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:55.500496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:55.527734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 384/788] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:55.539866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.604532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:55.641811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540616d-7a0e-4c9a-b7e8-fc39a327907a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.687160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:55.690719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.692075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.692366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.692841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.723227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:55.730004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:55.731276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:55.732312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 405/789] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:55.738645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.739275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f5014-b33f-44db-b8bf-8d8389a9d0a4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.777977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.779209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.779637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.780096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.788673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:55.790268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:55.820279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:55.821376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:01:55.822333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:55.825209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 385/790] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:55.833355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:55.947557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d6aa3-8b3a-4dc2-9790-9aa77d7fba62 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:55.987583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:55.988756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:55.994431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.001815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 406/791] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:56.014118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.040699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d084a-c9ab-4894-9dda-51dc3de3af2b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.075536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.106746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.108655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.110193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.110716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.111837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:56.113113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.116795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.152049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 386/792] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:01:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:56.156602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.225096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c6b-bf7a-4bbe-9ae9-72eda23c9ea5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.288360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.289389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.289832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.290320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.309844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495f122-bc6a-4873-8908-7985d631f3b4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.312817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.314584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:56.344192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:56.345307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:56.346426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:56.346426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:56.346426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:56.346426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:56.348796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 407/793] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:56.354274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.372854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.374168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.375318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.375958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.393326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.395900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:56.427551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:56.428670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:56.429712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:56.429712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:56.429712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:56.429712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:56.431675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 387/794] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:56.442561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.450870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.490784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.553180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8c038-3a49-4d3d-ad9c-5bc9406f0908 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.574632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bacb-524a-4dd7-8614-dfd607301153 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.612536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.614276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.614601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.614892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.615622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:56.615939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.617410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.636186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 388/795] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:56.639803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.655138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.655983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.656379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.656788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.657646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:56.658062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.659588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.688941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 408/796] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:56.694716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.739181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.751400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705984-2aa1-4bcb-b037-f0e5ae042f42 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.789129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.790045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.790400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.790774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.797774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.799345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:56.814201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:56.815186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:56.816100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:56.820099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 389/797] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:01:56.821316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:56.923611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ecc44-c5c9-4295-ae14-f51901020832 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.956710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749899-fd7e-4a8e-8716-9fc5005c638b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:56.958540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:56.959211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.959492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.959770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.960556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:56.960860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:56.962306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796a549-2af8-4819-ae39-bd378c828e9d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:56.974629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.984415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 390/798] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:56.986135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6dbe-4daa-44a2-91ad-eeef2426900c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:56.986531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6dbe-4daa-44a2-91ad-eeef2426900c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:56.986899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6dbe-4daa-44a2-91ad-eeef2426900c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:56.993876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 391/799] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:56.993876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6dbe-4daa-44a2-91ad-eeef2426900c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.005728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.007909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.008911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.009410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.009871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.018199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.020056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-99e245fb-7c74-4d43-9810-70550f98b4e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:57.036204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:57.037235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:01:57.038205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:57.040970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 409/800] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:01:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:57.042696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.043845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.044705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.068692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:57.068692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:57.114474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6dbe-4daa-44a2-91ad-eeef2426900c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.149525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 410/801] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:57.150758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.156873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.157774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.158064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.158344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/29d1b699dac04f23bf3e2f6cd54d33a4/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.161426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=29d1b699dac04f23bf3e2f6cd54d33a4, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.162930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.260032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.264936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb74ac-0c50-4c34-96e1-6d291f3f3625 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.271761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 392/802] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:01:56 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/29d1b699dac04f23bf3e2f6cd54d33a4/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:01:57.273143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.343347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.343997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.344246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.344526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.345387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:57.345935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.347186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.367331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.385959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 411/803] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:57.391513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.412171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b040-92f2-480e-8ae0-f442283f629e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.455479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.456778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.457220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.457609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.458951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.460645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e8da68b2-ad07-480e-b6ad-07ea223d8230 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:57.475813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:57.477034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 15:01:57.478071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:57.480313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 393/804] 10.222.0.74 () {56 vars in 1129 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:57.483191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b963-45ff-44c0-b369-d449244fef3b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.483738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b963-45ff-44c0-b369-d449244fef3b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.484222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b963-45ff-44c0-b369-d449244fef3b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.486211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 394/805] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:57.491099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09b963-45ff-44c0-b369-d449244fef3b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.568815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45700-c6c8-4b97-8f7c-8df81b952242 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.606842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.607420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.607705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.607981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.619379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09b963-45ff-44c0-b369-d449244fef3b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.635775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.651963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.656951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.657629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.657918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.658202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.658953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:57.659267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.660863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb095-077f-4da9-92ae-ccfe18de01e6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.665582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 395/806] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:57.666671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71666-4cf2-4eda-ade4-e91a2092210a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.666943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71666-4cf2-4eda-ade4-e91a2092210a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.667221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71666-4cf2-4eda-ade4-e91a2092210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.685792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-baf71666-4cf2-4eda-ade4-e91a2092210a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:57.686009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.687372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fe50-54f1-4df3-a37f-210e6ce3a313 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.687860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-baf71666-4cf2-4eda-ade4-e91a2092210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:57.773372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 396/807] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:57.774966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4215a-8a73-425b-9ac0-02f18ab4e722 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.775425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4215a-8a73-425b-9ac0-02f18ab4e722 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.775850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4215a-8a73-425b-9ac0-02f18ab4e722 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.781356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 397/808] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:57.782255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4215a-8a73-425b-9ac0-02f18ab4e722 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.818280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 412/809] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 15:01:57.819619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.819907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.820180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.837127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:57.838302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:57.896353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.905214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4215a-8a73-425b-9ac0-02f18ab4e722 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:57.921071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 413/810] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:01:57.921779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:57.952312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:57.961628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:57.974550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:57.975054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 398/811] 10.222.0.74 () {56 vars in 1124 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:57.975054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.049320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244482b-e60b-425d-bf98-1833c18ecbcf None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.074096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f6d4-c115-4117-a77a-c2ab66b40ece None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.086914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.087717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.088001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.088273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.088923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.090297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:58.104881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:58.106008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:58.107836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 414/812] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:58.108709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.117666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.118491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.118783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.119052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.132189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.133663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:58.151587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:58.152511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:58.153412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:58.153412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:58.153412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:58.153412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:58.157274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 399/813] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:58.158118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.164023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.206109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.220461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793216c-c8b7-47cc-a7ff-cd4e304cf0c9 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.256378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.257433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.257857 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.258142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.264348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2f650-0b2e-4257-b720-8e4a511b563d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.268635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:01:58.276555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:58.277509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:58.278351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 415/814] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:58.279091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.304114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.304777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.305066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.305350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.306086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.307502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.377889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379ab00-a44e-4acc-ae67-d0811577823b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.387997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.412475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.413080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.413373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.413649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.414355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] RBAC: Adding query filter params (name=network) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:58.414713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.416089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.418792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 400/815] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:01:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:58.419628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.434390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 416/816] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:58.434390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.547294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.557881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aa811-f37a-402d-bf54-255a86528e76 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.579919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074950-8e54-4457-b787-d5cfd139721c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.610068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.611374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.611756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.612348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.614187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:58.614187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.616452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.627889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.628567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.629421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.634328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.634509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 401/817] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:58.634509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.634685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:58.634685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.634685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.643240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 417/818] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:58.654270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.685274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.746827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b197fa-1cdc-47fd-8d03-dc2e57596428 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.764832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e3d2-6335-41a7-9cd0-046717e8f87c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.786297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.787231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.787709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.788235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.789167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:58.789690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.791666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.797685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 402/819] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:58.798926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.808149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.809269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.809771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.810281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.819561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.821942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:58.824002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:01:58.841462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:58.842492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:01:58.843415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:58.851570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 418/820] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:58.852609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:58.928416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1065-bdf9-4db4-acb8-1d834871dce2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.972028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:58.973261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:58.973654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:58.974041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:58.975755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:58.982923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0524b6-c944-47e1-bb31-58bbe6e355ce None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:58.987956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:58.990075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:59.018556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:59.020184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 403/821] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:59.021132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.028319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.028992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.029277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.029555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.030301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.031712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.097197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:59.115545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 419/822] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:01:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:01:59.116653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.132129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9242a0-d54c-468a-97df-2f09ffaee5de None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.213927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.213927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.214492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.214876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.215935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:59.216359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.217925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.246136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 404/823] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:59.252017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.253130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431bc8-95f8-482a-b240-37e2e0091381 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.324716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.325694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.326181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.326629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.328195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:59.328854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.330803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.348663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 420/824] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:59.355043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.372635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:59.449080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee464d-0616-46d0-b491-a184530c3a2e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.487995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:59.514217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.514430 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ce518-8a36-40cd-a328-94ea116f46b5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.514523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.524599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 405/825] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:01:59.560448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.561295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.561579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.561849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.575135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.576598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7eee0a4e-01ed-4332-85dd-38b211cb91cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:01:59.595859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:59.596893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:59.599063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 421/826] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:59.603301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.673435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06a1ab-3ac9-4a71-be7c-63d21c06fb97 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.673845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06a1ab-3ac9-4a71-be7c-63d21c06fb97 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.674045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06a1ab-3ac9-4a71-be7c-63d21c06fb97 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.676496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 422/827] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:01:59.682715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.683071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.683283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.701574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:01:59.702851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:01:59.730064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c855ad-51a8-41c4-a32b-40363d438bd6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.769341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.770614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.770895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.771164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.772368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:01:59.772681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.774392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.789198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 423/828] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:01:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:01:59.795143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 406/829] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:01:59.800229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.809728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:59.813164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.871122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:59.914832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764d52-7293-46cb-8b0b-f94abac4a9be None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.938158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230ee5a-e0da-4236-b69d-5dbfc2f3e94b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:01:59.958437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.958437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.958437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.958437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.963512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:01:59.965194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:01:59.979826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:01:59.980619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:01:59.980900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:01:59.981171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:01:59.985346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:01:59.986390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:01:59.987454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:01:59.987454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:01:59.987454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:01:59.987454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:01:59.989242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 424/830] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:01:59.994056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:01:59.997515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:00.007289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:00.009469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:00.011721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 407/831] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:00.023431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.060636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.111916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b7b7e-7ca6-4512-a08e-62cf4a926408 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.158143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.159148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.159619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.160137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.161739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:00.162239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.163832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.165674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80a39-bf50-447f-b73a-c486cf966bd4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.177936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 425/832] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:00.178617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.183511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.212968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.213668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.214199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.214510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.215723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:00.216041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.217678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.234468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 408/833] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:00.238958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.309265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20d240-1d91-4421-9138-9f350ea23560 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.325742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.353863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.355657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.356530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.357023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.367703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.375219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00cd26-b3be-4e98-b40d-61c82ddae866 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:00.390779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:00.391717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:00.392611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:00.400795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 426/834] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:00.401619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.424226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.425074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.425359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.425635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.437807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.439352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:00.460447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:00.461424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:00.462311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:00.462311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:00.462311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:00.462311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:00.466567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 409/835] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:00.467648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.494080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.517176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3fac-7fc0-4403-a82c-531f12ad4bd6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.553474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.554542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.555041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.555529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.556540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:00.557061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.558726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.576059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 427/836] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:00.576861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b250-cdf5-42f7-a782-e4ab1077e3e2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.577898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.614761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.615452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.615906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.616195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.616923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.618091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:00.619332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.619957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.638074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 410/837] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:00.639510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.693975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a03c96-e179-48e4-85fd-3dfdc9760ca1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.730758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.732280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.733200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.734568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.735115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/580d7a05a3cd412db56c0478b5b3842d/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.751875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21886a23-f887-4e44-aa4b-afdeee5828ba None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.756351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=580d7a05a3cd412db56c0478b5b3842d, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.758039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.789733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:00.790684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.794109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.794109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.800014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:00.802067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d61e0029-a5f9-4a1d-8c76-2b0bd28fc064 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:00.822464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:00.823511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 15:02:00.824450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:00.825021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 411/839] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:00.825449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 428/839] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:02:00 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/580d7a05a3cd412db56c0478b5b3842d/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:02:00.826580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7778b4-a6f9-47cc-aa67-6dfe29f87d96 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.826822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7778b4-a6f9-47cc-aa67-6dfe29f87d96 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.827104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7778b4-a6f9-47cc-aa67-6dfe29f87d96 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.827435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:00.828618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 412/840] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:00.834688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:00.835310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:00.835800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:00.855240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:00.856483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:00.946893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 413/841] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:00.948543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:00.961900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906896-5ea6-486b-81bb-5c2f68399f26 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:00.964680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.006019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.007006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.007448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.007916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.008929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:01.009399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.011970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.036760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 429/842] 10.222.0.74 () {56 vars in 1135 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:01.041871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.064931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.100579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127d3f-786a-4471-a947-6e4db88b0aca None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.147449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.148779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.149071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.149351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.150296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.152061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:01.172016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:01.173504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:01.174364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:01.176731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bdac-a71f-484d-89f2-502f7f9c5322 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.178485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 414/843] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:01.180423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.221683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.222945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.223878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.224645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.245726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.319233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.321000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.323436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b559d-9c34-43f0-8a9c-a14b9dee41d6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.371557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.372163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.372452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.372735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.373452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:01.374114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.375935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.377840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.386596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 415/844] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:01.390952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.439458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 430/845] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 15:02:01.440715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.484604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.505445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc3a89-ea43-451e-8f53-bb9d1ddef5bc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.547158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.547976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.548362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.548645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.549362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:01.549673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.551668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.551812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3b7ed-e675-42d8-9868-ffc413f863c2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.562590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 416/846] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:01.590340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.591201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.591490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.591776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.604376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.605870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:01.626058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:01.627061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:01.628600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:01.628600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:01.628600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:01.628600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:01.628600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 431/847] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:01.635536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.714493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.765356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7dae5-26b8-4547-8776-a23338729a89 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.807672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.808350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.808637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.808918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.809649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:01.809959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:01.811374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5208-d789-457e-b44a-585ed0168071 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:01.824588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 417/848] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:01.831480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:01.938791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:01.945358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e190f2-2c06-467f-9409-751e3c57c249 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:01.980600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecdb90-6ee8-4e7f-afe7-687e2f0da713 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.980956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecdb90-6ee8-4e7f-afe7-687e2f0da713 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.981162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecdb90-6ee8-4e7f-afe7-687e2f0da713 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.983269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 418/849] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:01.989084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.989778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.990267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:01.991154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:01.992015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:01.992303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:01.992648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.001534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.003635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.010140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:02.011643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:02.021727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:02.022711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:02.023632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 432/850] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:02.028858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:02.098688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 419/851] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:02.112564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:02.145469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e711-da34-42b1-97b2-ee30af8ac06a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:02.175576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:02.182335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:02.183316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:02.183751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:02.184175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.185139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:02.185607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.187244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.205678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 433/852] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:02.206883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:02.223956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eaa41-dc8d-4e6a-b922-a3e5bad0dc59 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:02.226454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:02.260026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:02.260929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:02.261280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:02.261623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.262376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.263962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:02.277138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:02.278101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:02.279001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:02.282858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 420/853] 10.222.0.74 () {56 vars in 1132 bytes} [Fri May 27 15:02:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:02.284477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:02.321325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228f1a-bb25-4c47-9480-2e10203e0dc0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:02.369515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:02.370913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:02.371547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:02.372151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.373416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=29d1b699dac04f23bf3e2f6cd54d33a4) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:02.373916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.376336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.390572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 434/854] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:02 2022] GET /identity/v3/role_assignments?user.id=29d1b699dac04f23bf3e2f6cd54d33a4&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:02.400060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a24c-62fb-438f-9d86-c2c54d1dbdee None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:02.424055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:02.439482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0403e-a612-42da-8275-af248163994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:02.440080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0403e-a612-42da-8275-af248163994b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:02.440359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0403e-a612-42da-8275-af248163994b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:02.440631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0403e-a612-42da-8275-af248163994b None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.442008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0403e-a612-42da-8275-af248163994b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:02.442317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0403e-a612-42da-8275-af248163994b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.443923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0403e-a612-42da-8275-af248163994b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.449459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 421/855] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:02.455476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:02.560214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:02.585468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f9680-475a-4e36-b36e-230892206562 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:02.623332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:02.624386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:02.624890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:02.625366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:02.626260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:02.626598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:02.627964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bf090-d530-4443-a483-ba3f13fcf7ff None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:02.633180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 435/856] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:03.195454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcfee7-0ef1-4512-a14a-d623b6936382 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.195973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcfee7-0ef1-4512-a14a-d623b6936382 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.196075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcfee7-0ef1-4512-a14a-d623b6936382 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.197675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 422/857] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:03.203128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.203543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.203686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.221668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:03.222944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:03.293161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 436/858] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:03.317644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcfee7-0ef1-4512-a14a-d623b6936382 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:03.432661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcfee7-0ef1-4512-a14a-d623b6936382 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:03.468512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:03.469231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.469513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.469786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.481100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:03.489530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:03.490585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:03.491429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 423/859] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:03.496896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:03.570386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:03.600474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ec4e-f568-4a2c-8231-529ff58cdb80 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:03.637596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:03.638285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.638609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.638887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.639903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:03.640212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:03.641596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:03.651830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 437/860] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:03.657578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:03.706807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:03.768723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755370a-1172-4a5c-8487-f37aa76b2da5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:03.805951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:03.806777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.807060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.807335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.818477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:03.819938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8fc87d27-e54e-4320-8c07-9cea544c8717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:03.837501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:03.838467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:03.839557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:03.839557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:03.839557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:03.839557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:03.839557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 424/861] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:03.845916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:03.892530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017cb02-32d1-4c58-9ca6-058103ac4c02 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.893186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017cb02-32d1-4c58-9ca6-058103ac4c02 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.893690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017cb02-32d1-4c58-9ca6-058103ac4c02 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.895450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 425/862] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:03.902008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.902302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.902615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:03.924524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:03.926285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:03.961378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e6e73-15bf-415d-9d5f-40bc52e4779e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:03.998379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:03.999115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:03.999404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:03.999684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.000403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:04.000721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.002169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.006869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 426/863] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:04.007158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.026085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 438/864] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:04.027023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.027692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.058533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.137507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a382b-ae35-4ced-b6d9-dfd6e48eb182 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:04.163252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540ce37-baf4-4840-8343-4da19bfdf42a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:04.176283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:04.177362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.177845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.178318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.186266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.187962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.203568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:04.204284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.204572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.204847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:04.205157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:04.206312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:04.208103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:04.208642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.208642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.210913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 439/865] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:02:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:04.216343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.281276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.291896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 427/866] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:04 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:04.337858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba1a3-7c20-4177-8692-b3949bf5d8f7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:04.386503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:04.387209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.387495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.387767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.388616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:04.388922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.390852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.411285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 440/867] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:02:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:04.416985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.514323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.534497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c1e6-7778-486e-a272-bff777879d5b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:04.570074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:04.570771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.571051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.571327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.642648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.645191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3198-a3b4-4afc-8f9c-12fe4237dab2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.738809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.764609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 428/868] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:04 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:04.766911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.871874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723de-091d-49b7-98f5-58fd7ff5dabb None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:04.880717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c2ff-79b8-4e6a-a693-cfb86400150a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.881028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c2ff-79b8-4e6a-a693-cfb86400150a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.881400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c2ff-79b8-4e6a-a693-cfb86400150a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.883067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 429/869] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:04.888383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166143-d187-43fc-8aaa-c3de1183f042 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.888666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166143-d187-43fc-8aaa-c3de1183f042 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.888945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166143-d187-43fc-8aaa-c3de1183f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.890218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:04.912319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-62166143-d187-43fc-8aaa-c3de1183f042 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:04.913540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-62166143-d187-43fc-8aaa-c3de1183f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:04.923138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:04.924402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.924692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.924972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.936788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:04.938630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-39188e8e-d7fb-4918-a73d-79ca4c80876a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:04.958532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:04.959478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:04.960408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:04.960408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:04.960408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:04.960408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:04.960408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 441/870] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:04.961169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33111-89ef-4db6-bbcf-5a2441471993 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.961696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33111-89ef-4db6-bbcf-5a2441471993 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.961696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33111-89ef-4db6-bbcf-5a2441471993 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:04.970206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 442/871] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:04.970206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33111-89ef-4db6-bbcf-5a2441471993 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:04.994147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 430/872] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:04.996004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e451-e577-4744-bbd2-692217689686 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:04.996445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e451-e577-4744-bbd2-692217689686 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:04.996853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e451-e577-4744-bbd2-692217689686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.023558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5120e451-e577-4744-bbd2-692217689686 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:05.024771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5120e451-e577-4744-bbd2-692217689686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:05.077581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33111-89ef-4db6-bbcf-5a2441471993 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.096182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 431/873] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:05.097026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e451-e577-4744-bbd2-692217689686 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.125199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.126164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.126484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.126766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.127496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:05.127806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.129244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.146374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 443/874] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:05.146374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.151362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:05.170144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:05.205888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e451-e577-4744-bbd2-692217689686 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.243668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.244885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.245322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.245749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.246686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.248342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.252526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd7796-0953-451f-a4e4-39d3f1389e0c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:05.262007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:05.263262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:05.264630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:05.267443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 432/875] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:05.268372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.297004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.297787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.298074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.298362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.299119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.301262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.374772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd9847-5768-4d88-9dfa-3dc672fe526f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.383707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:05.401782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 444/876] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:05 2022] POST /identity/v3/services => generated 269 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:05.411747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.418210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.419067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.419353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.419627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.435419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.437055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:05.453372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:05.454402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:05.455356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:05.460681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 433/877] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:05.461658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.549149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:05.579563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2813-9a8b-4cb1-8c68-a10cd84dabbd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.589669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8f88-c69a-401a-b118-1dc8b9c7f0b2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.634890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.635490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.635776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.636055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.637700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:05.638574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.640512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.647516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 445/878] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:05.656290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.656290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.656290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.657180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.657667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.659219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:05.660007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.663599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.679943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 434/879] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:05.686193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:05.718255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:05.783896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7e8d0-be51-4536-ada9-f1f4670c5207 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.811648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a86aa-8040-4491-8e63-0cf7d270ecac None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:05.822141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.823066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.823530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.823971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.824835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:05.825301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.826856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb883c6-bbc8-4aa5-b9fb-482a2a698365 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.837812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 446/880] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:05.856220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:05.857345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:05.857875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:05.858396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:05.859858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=580d7a05a3cd412db56c0478b5b3842d) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:05.860417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:05.862390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f4cd-819b-47da-a894-64818f89e9a1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:05.870249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 435/881] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:05 2022] GET /identity/v3/role_assignments?user.id=580d7a05a3cd412db56c0478b5b3842d&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:06.654070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842e6d-04cc-475a-9300-ceece6202b9e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:06.654616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842e6d-04cc-475a-9300-ceece6202b9e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:06.654616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842e6d-04cc-475a-9300-ceece6202b9e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:06.662713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 447/882] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:06.662795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:06.662795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:06.662795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:06.679678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:06.680868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:06.752640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 436/883] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:06.776044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3842e6d-04cc-475a-9300-ceece6202b9e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:06.787662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:06.886260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3842e6d-04cc-475a-9300-ceece6202b9e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:06.923139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:06.923950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:06.924237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:06.924515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:06.925167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:06.927116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:06.941090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:06.942352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:06.943327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 448/884] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:06.950570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:06.991558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:07.054061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f4d6e-dea3-4f3c-8f9d-2885729ba2cd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:07.090931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:07.091936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.092419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.092891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.093799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:07.094303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:07.095906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:07.101474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 437/885] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:07.107888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:07.185328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:07.216756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891880ac-f48e-4b22-8c2d-687ca6b638d2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:07.253535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:07.254243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.254556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.254904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.255649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:07.255959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:07.257332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:07.262979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 449/886] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:07.269159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:07.355008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:07.374836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ebd19-500c-4e2b-ba71-1d1fdfae3bdf None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:07.412013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:07.412683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.412973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.413255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.414044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] RBAC: Adding query filter params (interface=public, service_id=cd802666878b4530aed02fa00e0407fe, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:07.414359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:07.415770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb33a5-f3b7-4e7f-9a45-fc7db2368673 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:07.421382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 438/887] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:02:07 2022] GET /identity/v3/endpoints?service_id=cd802666878b4530aed02fa00e0407fe&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:07.427176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:07.538092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e026fe-ef8d-47a4-a57d-82686ca4c3ce None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:07.575333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:07.576379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.576896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.577389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.578279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:07.579874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eefd7-4ef4-44e9-8f59-38050d822ad5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:07.581940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:07.587615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 450/888] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:07 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:02:07.857471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12bd1-cb7b-46b5-a61b-3591b66966e9 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.857986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12bd1-cb7b-46b5-a61b-3591b66966e9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.857986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d12bd1-cb7b-46b5-a61b-3591b66966e9 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.859626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 439/889] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:07.866050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:07.866529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:07.866627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:07.884657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:07.885858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:07.962287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 451/890] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:07.984418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12bd1-cb7b-46b5-a61b-3591b66966e9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.097472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d12bd1-cb7b-46b5-a61b-3591b66966e9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.133639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.134379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.134694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.134972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.135624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.137007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-502409b6-9d67-4eb2-be0e-5ee46f9043c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:08.150438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:08.151429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:08.152284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:08.155369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 440/891] 10.222.0.74 () {56 vars in 1132 bytes} [Fri May 27 15:02:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:08.159539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.214772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966171-9fce-43ae-8fc5-25b5700f74d3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.215440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966171-9fce-43ae-8fc5-25b5700f74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.215942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966171-9fce-43ae-8fc5-25b5700f74d3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.217536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 441/892] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:08.223653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.223940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.224220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.241532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:08.242765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:08.245685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:08.275283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f6d3-3570-4b1c-8206-d34c661dac0c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.306697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:08.312209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.312880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.313261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.313434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.314136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:08.314482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.316928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.323682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 442/894] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:08.326890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 452/894] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:08.327939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.349384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.446871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86073-86fc-4b66-8545-94f55406132d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.473865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514b599-aefe-4248-9297-463fe19e3fd4 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.482856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.483658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.483937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.484205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.485021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:08.485322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.486712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68d151-33ea-4305-ba5b-77204f89603a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.497483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 443/895] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:08.497483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c62b-4d8a-4ed5-8a28-08c82f1a48e4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.497483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c62b-4d8a-4ed5-8a28-08c82f1a48e4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.497483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c62b-4d8a-4ed5-8a28-08c82f1a48e4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.497483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 444/896] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:08.499601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c62b-4d8a-4ed5-8a28-08c82f1a48e4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.503457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:08.515705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.516391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.516663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.516942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.517660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.519060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed8d9e-c4fc-4257-a54e-bc803c76d607 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.590451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 453/897] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:08 2022] POST /identity/v3/services => generated 241 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:02:08.590451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.590451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.590451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.613102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:08.615415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:08.620129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c62b-4d8a-4ed5-8a28-08c82f1a48e4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.661411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.662378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.662846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.663274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.664281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] RBAC: Adding query filter params (interface=public, service_id=f098b1780bb645e7900ad46f8cfdcbde, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:08.664747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.666308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.672900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 445/898] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/endpoints?service_id=f098b1780bb645e7900ad46f8cfdcbde&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:08.677719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:08.678769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.707416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 454/899] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:08.724922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:08.761636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:08.811607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44bec7-8db9-484a-be5f-f2336b1e2622 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.855031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.855388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc57649-6fe0-4c66-ba94-b81095b37ffb None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:08.855709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.855995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.856267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.856951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:08.858340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:08.873484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 446/900] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:02:08.895789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:08.896814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:08.897402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:08.897780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:08.910577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:08.919514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:08.920567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:08.921432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 455/901] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:08.931608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.049251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f632-5d2c-4739-b053-1c083cc20403 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.082967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:09.091533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109f18-665c-4f92-9540-34d81247973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.092204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109f18-665c-4f92-9540-34d81247973b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.098834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109f18-665c-4f92-9540-34d81247973b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.098834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109f18-665c-4f92-9540-34d81247973b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.098834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109f18-665c-4f92-9540-34d81247973b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:09.098834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109f18-665c-4f92-9540-34d81247973b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:09.098834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109f18-665c-4f92-9540-34d81247973b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:09.106905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 447/902] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:09.112147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.162006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:09.219252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458f87-d737-452e-b43c-6fdeda3ea544 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.258708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.259512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.259797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.260077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.272153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:09.273612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:09.291522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:09.292486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:09.293411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:09.293411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:09.293411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:09.293411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:09.293411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 456/903] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:09.299917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109f18-665c-4f92-9540-34d81247973b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.408832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109f18-665c-4f92-9540-34d81247973b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.443347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.444020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.444305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.444573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.445294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:09.445598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:09.447005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:09.460451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 448/904] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:09.467462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.571380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:09.577584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12f96f-e576-476b-9638-47b316f4aae0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.611665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.612579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.612867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.613682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.621307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:09.622770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:09.639685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:09.640728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:09.641695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 457/905] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:02:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:09.648532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.701484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:09.752737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265baf-dcec-4711-b923-1744c1a575cc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.793267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.793941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.794223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.794518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.795356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:09.795659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:09.797155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f92cc-abde-4779-af2b-d0ee0a4fc18a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:09.815605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 449/906] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:02:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:09.821892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:09.931460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f343e-7034-41b7-be9e-103938c3719c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:09.975244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:09.975903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.976190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.976467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.984433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234aff-05f1-40e5-b133-7e530da2fb00 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.985409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234aff-05f1-40e5-b133-7e530da2fb00 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.985952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234aff-05f1-40e5-b133-7e530da2fb00 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:09.989668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 450/907] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:09.994191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:09.994779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:09.995264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.002895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.016071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:10.017580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:10.061206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.062939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.111947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 451/908] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:10.139105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.184234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 458/909] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:09 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:10.185668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.192297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.250098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.264889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ff04c-b9af-4998-9dfc-5385af6a2c02 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.304063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.305309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.305821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.306303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.307181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.307303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65e00-4186-47b4-9581-ff5c63f62564 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.309000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:10.322657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:10.323677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 15:02:10.324545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:10.332857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 452/910] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:10.334556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.343968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.344791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.345555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.345844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.364294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.366435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:10.390268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:10.391427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:10.392590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:10.392590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:10.392590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:10.392590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:10.398293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 459/911] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:10.403397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.462719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932ba2-e413-4b80-bca3-211ff4c89d04 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.464880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.509839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.510871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.511330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.511795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.512701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:10.513234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.515126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.520618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 453/912] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:10.526740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.542240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e99cc-342f-4c6c-b27f-9eca17f84069 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.554573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.592956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.593678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.593967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.594250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.595360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:10.595674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.598026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.618521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 460/913] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:10.620851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.653499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28823-a8e8-4b09-b0e2-406edb2775c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.701310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.702391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.702973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.703539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.704535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:10.705039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.706727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.712912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 454/914] 10.222.0.74 () {56 vars in 1114 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:10.719315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.743373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa82f-d9c0-43aa-865a-9cd7b32483a1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.759057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.781901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.783106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.783593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.784072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.794088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.796104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:10.812855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:10.813873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:10.814815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:10.822531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 461/915] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:10.824101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:10.849890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935958ce-b479-4bd9-bc5a-7c66a717195d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.857190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:10.901778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:10.902377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.902691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.903453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:10.904324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:10.905981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d0a03-e5ae-4c6f-8384-d82b7dda2e70 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:10.940128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cf1f-da93-49b2-86b2-0dc50e6e8677 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:10.986641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 455/916] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:02:10.997609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3bdb-48aa-436f-8752-5da957f3ca59 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:10.997928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3bdb-48aa-436f-8752-5da957f3ca59 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:10.998237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3bdb-48aa-436f-8752-5da957f3ca59 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.000029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 456/917] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:11.006653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.007320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.007844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.009441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.010184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.010507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.010843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.011649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.012017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.013619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.029197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:11.030848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:11.034681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 462/918] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.037129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.129928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 457/919] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:11.149511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.154067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.171337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982b1f-5b8d-4a4e-a01e-b2f005f7116c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.172090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.213240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.213957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.214248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.214558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.215452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] RBAC: Adding query filter params (role.id=d071b074106340aa8b8a137e7475350d, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=580d7a05a3cd412db56c0478b5b3842d) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.215701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.217141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d324-6f8c-465a-a734-67216170ae30 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.224403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 463/920] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/role_assignments?user.id=580d7a05a3cd412db56c0478b5b3842d&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d071b074106340aa8b8a137e7475350d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.225574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e581e1-a616-48b5-85d1-c3cda97ea7d9 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.225870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e581e1-a616-48b5-85d1-c3cda97ea7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.230326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e581e1-a616-48b5-85d1-c3cda97ea7d9 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.230326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 464/921] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:11.233327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.233687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.233984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.255434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:11.256700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:11.280635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fef16a-ee7f-437b-8a43-448580232519 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.330661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.331830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.333126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.333711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.335389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.337324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.351276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 465/922] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:11.354647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:11.355649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:11.356501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.359280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 458/923] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:11.365800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.377337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.466660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.495744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.496895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012869-aae5-420b-bf2d-dc06240c6dc6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.522359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2f1d-77f0-4c2f-a3f8-df7efa44afef None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.536908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.539295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.539740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.540414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.541295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.542116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.544072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.552300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 466/924] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.559584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.567311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.568587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.569131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.569623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.570517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.572040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:11.585250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:11.586260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:11.587147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 459/925] 10.222.0.74 () {56 vars in 1132 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:11.593093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.672188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d795d70-8db3-411f-9342-c6439f43a7e7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.708986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d095b-7df4-45c6-9c59-08bdc05538d3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.710929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.711829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.712310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.712797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.713709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.714242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.715971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.731583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 467/926] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.731583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.739517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.747037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.747723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.748015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.748303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.749031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.749349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.750838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.756873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 460/927] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.762913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.790778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:11.846265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4dace-cf70-48df-9362-7e30f2d6a851 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.884407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.885106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.885395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.885676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.886616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] RBAC: Adding query filter params (interface=public, service_id=faf72f72914a4f2c984017bfdf94a476, region_id=RegionOne) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.887036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.888423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.893208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2ee0-4be6-42c5-bb1f-8434f0b82da5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:11.900553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 468/928] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/endpoints?service_id=faf72f72914a4f2c984017bfdf94a476&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:11.906316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.949264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:11.950309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:11.950864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:11.951360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:11.952271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:11.952792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:11.954366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:11.964660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 461/929] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:11.965805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:11.998622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:12.040495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b48c-bcb6-465b-b00f-2b4a55279e93 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:12.045378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:12.077464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b88fd-5d62-45e8-929d-1e9721ed77c5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:12.077919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:12.078615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:12.078901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:12.079177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:12.079861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:12.081957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585a0eb-9e91-4850-815d-df26c046372d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:12.094819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 469/930] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:11 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:02:12.119635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:12.120945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:12.121462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:12.121948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:12.122968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:12.124623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784374a-4066-4b8b-bc0c-d907c6ba5111 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:12.231938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 462/931] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:13.370909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732d2b-ab31-49a6-8d5a-76f8fd63688e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.371476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732d2b-ab31-49a6-8d5a-76f8fd63688e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.371815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732d2b-ab31-49a6-8d5a-76f8fd63688e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.374602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 470/932] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:13.382758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.383260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.383577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.406659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:13.407879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:13.490298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf396-d946-4ba0-a473-118f1fc36de4 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.490670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf396-d946-4ba0-a473-118f1fc36de4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.490889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf396-d946-4ba0-a473-118f1fc36de4 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.492504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 471/933] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:13.495512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 463/934] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:13.497303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.497594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.497874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.515791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:13.516993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:13.519144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:13.589628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:13.593083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 472/935] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:13.617251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:13.641345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516695-9652-4bc9-badd-b889092b3f4f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:13.684840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:13.685938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.686220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.686815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.687520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:13.689468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:13.691583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING keystone.server.flask.common [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 15:02:13.695092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:13.736723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdc2fa-06a7-4464-96c0-9c8cbd6f394e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:13.740518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.sql.core [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 15:02:13.740518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 15:02:13.740518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [parameters: {'id': 'b90c1f31299842d991798e4c7c46afa8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 15:02:13.740518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b90c1f31299842d991798e4c7c46afa8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b90c1f31299842d991798e4c7c46afa8. May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:02:13.764161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 15:02:13.765524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application yield resource May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.rollback() May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.force_reraise() May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise self.value May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application session.commit() May 27 15:02:13.766804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._prepare_impl() May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.flush() May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._flush(objects) May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application compat.raise_( May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application flush_context.execute() May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 15:02:13.768157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rec.execute(self) May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 15:02:13.769388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:02:13.770391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [parameters: {'id': 'b90c1f31299842d991798e4c7c46afa8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.795496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:13.797342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b90c1f31299842d991798e4c7c46afa8. May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 464/936] 10.222.0.74 () {60 vars in 1140 bytes} [Fri May 27 15:02:13 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:13.799308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:13.800587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:13.800587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.800587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.800587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.801857 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:13.808092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:13.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:13.811629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:13.815547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 473/937] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:13.816853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:13.909351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430b6f-cf9d-4aa7-aad5-14ad6a60322f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:13.922994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:13.930033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470a57-1af6-463c-9518-22c5212f2fb1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:13.955324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:13.956564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:13.958139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.958526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.958829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.966030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:13.967786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:13.971033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:13.971941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:13.972422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:13.973469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:13.974550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:13.975358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:13.976940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:13.983547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:13.984445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:13.985425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:13.989568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 474/938] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:13.990554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 465/939] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:13.995361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:13.996600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.109227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafdff-be2e-48b6-8d64-8992b5406999 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.131446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ff3f-66bf-4082-b76c-7910025f7cdb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.156234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.157286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.157575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.157849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.169450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.170453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.170941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.171134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.171602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.172550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.172658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:14.173345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.175017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:14.192924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:14.193884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:14.195217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:14.195217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:14.195217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:14.195217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:14.201952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 475/941] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:14.203334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.206820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 466/941] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:14.253179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.326311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365ca4f-5521-43de-be1b-61f19333b876 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.366434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.367130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.367413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.367689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.368432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:14.368739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.370136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019be0-bf71-4d22-a2e6-b66b3c93636a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.384026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 476/942] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:14.391567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.412330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406760d-bfa0-43dd-9c44-52c21aa6383b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.412645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406760d-bfa0-43dd-9c44-52c21aa6383b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.412910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406760d-bfa0-43dd-9c44-52c21aa6383b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.415076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 477/943] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:14.420308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdbac6-fc7a-4576-af58-164540b40f95 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.420665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdbac6-fc7a-4576-af58-164540b40f95 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.420888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdbac6-fc7a-4576-af58-164540b40f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.428963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.443808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e0bdbac6-fc7a-4576-af58-164540b40f95 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:14.447591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e0bdbac6-fc7a-4576-af58-164540b40f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:14.522640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590b1b-7cc8-4c97-bc05-619b1ed4bc44 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.532260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 478/944] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:14.533434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401ccc-251a-4186-a2c7-0e739497d8cc None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.533720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401ccc-251a-4186-a2c7-0e739497d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.533993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401ccc-251a-4186-a2c7-0e739497d8cc None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.535878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 479/945] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:14.541192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.541482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.541765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.558520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:14.560166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:14.561191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.562085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.562741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.563091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.573491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.575498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.586038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:14.596709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:14.597717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:14.599173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.599769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 467/946] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:14.600518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.636124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 480/947] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:14.637045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.711009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.720359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b416f6-31cb-4d39-91d8-3d7d120383f2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.749173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478bfa-7105-42be-825e-1ef81cd95cb3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.756602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.757405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.757684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.757955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.758633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.759997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:14.773427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:14.774493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.775379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 468/948] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:14.776195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.798875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.800328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.801163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.801597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.803269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:14.803755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.805459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.824375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 481/949] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:14.825548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.843887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.885680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee166b-4754-4f54-bf65-5ddcbc5ab3cb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.927862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.928659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.928936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.929211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.929854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.931242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.937907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d07d-7cfc-4257-b913-c45c11ec7932 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:14.943578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:14.944605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:14.945487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 469/950] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:14.947126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:14.964913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:14.978810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:14.979489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:14.979777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:14.980052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:14.980761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:14.981072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:14.982461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:14.987563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 482/951] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:14.992967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.048451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2e53-372e-4769-98fb-8835cf5f070d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.079202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.083561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.084352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.084632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.084909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.095210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.096736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.101814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbd16-22ae-48e9-b7ec-d2221d84184b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:15.115507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:15.116516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 470/952] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:15.117474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.145745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.146917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.147205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.147487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.148200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:15.148565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.150233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.161210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 483/953] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:15.161871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.190104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.221700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fdd0a-9e7e-4b5c-b05d-4fe9aa2582e0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.259499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.260170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.260458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.260739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.261447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:15.261762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.263172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.267002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c45e2-af9f-477a-830d-c06a34704063 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.268410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 471/954] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:15.269193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.309931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.310652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.310947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.311227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.311943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:15.312379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.313740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.330477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 484/955] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:15.330477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.335770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.375494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a482ce4-c3d2-4f39-ba94-35e3af8d0a47 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.411359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.412030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.412313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.412590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.413293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:15.413599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.414989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.416241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.419754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 472/956] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:15.420543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.462947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705cae-33f0-4638-a831-231577e652c7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.522054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.523429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.523871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.524302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.526072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.527987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.548234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b3a8a-daa1-476c-aa43-3778648b5a60 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.588647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.589456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.589803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.590091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.600408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.602102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.607461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 485/957] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:15.622415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:15.623442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:15.624379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:15.626632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 473/958] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:15.633355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.706008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.760469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f7dad-e653-4d82-a581-40f2581b3693 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.798025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.798957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.799392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.799837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.800968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:15.801425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.803211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b97293-9cf2-4886-bf39-989454396c21 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:15.817270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 486/959] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:15.822915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:15.892186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:15.935539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba1d7-3192-410e-aad8-210052c92ac3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:15.972220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:15.974152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:15.974697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:15.975187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/580d7a05a3cd412db56c0478b5b3842d/roles/d071b074106340aa8b8a137e7475350d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:15.977818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=580d7a05a3cd412db56c0478b5b3842d, role_id=d071b074106340aa8b8a137e7475350d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:15.979523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba592983-e2cf-4a9e-ad00-72ddbf80ad85 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:16.093345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 474/960] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:02:15 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/580d7a05a3cd412db56c0478b5b3842d/roles/d071b074106340aa8b8a137e7475350d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:02:16.564821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ff2f-534b-4233-b5a1-d36599cd7372 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:16.565340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ff2f-534b-4233-b5a1-d36599cd7372 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:16.565419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ff2f-534b-4233-b5a1-d36599cd7372 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:16.567662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 487/961] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:16.573128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:16.573980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:16.574510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:16.592714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:16.594550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:16.688162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 475/962] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:16.714462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ff2f-534b-4233-b5a1-d36599cd7372 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:16.822113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ff2f-534b-4233-b5a1-d36599cd7372 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:16.840006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:16.859604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:16.860419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:16.860715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:16.860984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:16.861774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:16.863286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:16.864746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING keystone.server.flask.common [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 15:02:16.909618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.sql.core [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 15:02:16.909618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 15:02:16.909618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [parameters: {'user_id': '08671ab1e4eb43de8ee898b8f98eac19', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 15:02:16.909618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80536) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application conn.query(q) May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result.read() May 27 15:02:16.917810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:02:16.918736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application next(self.gen) May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application yield resource May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application next(self.gen) May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.session.rollback() May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.force_reraise() May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise self.value May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application session.commit() May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 15:02:16.920145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._prepare_impl() May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.session.flush() May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._flush(objects) May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application compat.raise_( May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application flush_context.execute() May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rec.execute(self) May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 15:02:16.921286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:02:16.922191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result = self._query(query) May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application conn.query(q) May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application result.read() May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:02:16.924659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [parameters: {'user_id': '08671ab1e4eb43de8ee898b8f98eac19', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:16.926879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 15:02:16.928768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:16.930959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 488/963] 10.222.0.74 () {60 vars in 1131 bytes} [Fri May 27 15:02:16 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:16.931852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:16.984449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:17.039671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c97f7-2e93-4cf6-87fa-ae562bd64bc0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:17.076036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:17.076746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.077031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.077362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.084725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:17.086198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-802279de-6dc9-4608-8aa1-f8e0d7f9a8b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:17.101160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:17.102714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 15:02:17.104503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:17.106721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 476/964] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:17.108568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:17.216060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb56a4-245b-4425-929b-f55c418ba015 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:17.257236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:17.258307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.258834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.259394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.260401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:17.260914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:17.262833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a390-326b-4b21-bcf1-c315cb04fd2c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:17.304424 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 489/965] 10.222.0.74 () {56 vars in 1101 bytes} [Fri May 27 15:02:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:17.897072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44a95-c284-4e06-bbc6-c6cd2642a2b3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.898042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44a95-c284-4e06-bbc6-c6cd2642a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.898331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44a95-c284-4e06-bbc6-c6cd2642a2b3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.899958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 477/966] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:17.907676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.908131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.908131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.926697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:17.928222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:17.960012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:17.965659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d452-464b-49bd-83ef-e879118bd5f6 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.965946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d452-464b-49bd-83ef-e879118bd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.966217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d452-464b-49bd-83ef-e879118bd5f6 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.967624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 478/967] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:17.972554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:17.975634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:17.975634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:17.989954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:17.991178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:18.000797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 490/968] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:18.025241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.074446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 479/969] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:18.089064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.130041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45d184-9bf8-46d2-9b43-697f181dfbca None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.131652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.170093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.170827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.171109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.171388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.172111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.173501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.197011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657a7c8-cd20-4da8-9996-d41c61da221b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.234022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.234872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.235157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.235437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.236089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.237466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.241441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 491/970] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:18 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0d31992b-f313-404f-a7ed-3d2e01e461b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:18.256146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:18.257302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:18.263927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 480/971] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:18.265042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.296237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.382760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edea4-d3c3-41f4-b7b5-4e8241cff3c1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.383126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edea4-d3c3-41f4-b7b5-4e8241cff3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.383333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edea4-d3c3-41f4-b7b5-4e8241cff3c1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.385031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 481/972] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:18.389163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf90-c873-4e69-a906-33c458b316a8 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.390564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.390852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.391276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.411251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:18.412628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:18.429287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.429882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.430172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.430464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.431171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:18.431477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.432877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.438622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 492/973] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:18.445648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.496739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 482/974] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:18.522663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.538002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.552993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.554940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1f20-ab4f-4da8-bbd1-bed2f72c3ba6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.592654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.593450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.593660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.593944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.594692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:18.595007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.596377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.602029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 493/975] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:18.607707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.625831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e894-7585-4c02-97f7-e7538f2d3464 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.663725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.664539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.664819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.665096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.675497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:18.683932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:18.684951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:18.687425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 483/976] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:18.691148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.720119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c249-7482-45ac-a3db-0fc7759a279e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.756138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.756814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.757096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.757371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.758160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] RBAC: Adding query filter params (interface=admin, service_id=faf72f72914a4f2c984017bfdf94a476, region_id=RegionOne) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:18.758495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.759858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.766038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 494/977] 10.222.0.74 () {56 vars in 1249 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/endpoints?service_id=faf72f72914a4f2c984017bfdf94a476&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:18.771562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.788054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.796353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:18.805425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a46e4-243c-4999-a527-5792e4feeb4c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.841496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.842661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.843157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.843653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.844578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:18.845078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.846478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.860176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 484/978] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:18.860927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:18.875778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104206bf-4d27-443b-b2af-6508105bf78e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:18.919156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:18.919931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:18.920284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:18.920631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:18.921373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:18.922842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:18.929821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 495/979] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:02:18.991299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1551017-5dfd-4230-82d7-0c786417182f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:19.029362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:19.030547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:19.031048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:19.031508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:19.044147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:19.045931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:19.065205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:19.066250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:19.067528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:19.067528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:19.067528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:19.067528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:19.072751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 485/980] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:19.073641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:19.161233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:19.181946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a876c0-0ceb-4ee8-a10b-40a0fc476886 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:19.217048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:19.217711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:19.217998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:19.218273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:19.219014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:19.219322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:19.220671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:19.233315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 496/981] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:19.238666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:19.248214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:19.341244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d325-4357-45ae-b42e-bb1a83ebc7bf None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:19.376214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:19.377049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:19.377338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:19.377613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:19.385731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:19.387259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:19.404209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:19.405363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:19.406366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 486/982] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:02:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:19.411810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:19.520495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf1d2-8bee-419d-ba06-675b2766cbce None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:19.554259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:19.554965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:19.555253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:19.555531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:19.556358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:19.556668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:19.558103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:19.567039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:19.581014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 497/983] 10.222.0.74 () {56 vars in 1149 bytes} [Fri May 27 15:02:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:19.582818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:19.657525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:19.695103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9719124-c979-4e51-9a9b-e58289529a8b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:19.734442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:19.735108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:19.735395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:19.735671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:19.805576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:19.806998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:19.869929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:19.915244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 487/984] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:19 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:19.923313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.023617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e1f2-7d7d-4081-b4ae-678a3f4a3b91 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.058633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.059368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.059650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.059923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.072447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.073904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:20.091876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:20.092806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:20.093734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:20.093734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:20.093734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:20.093734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:20.093734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 498/985] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:20.100124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.204821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c22-99a1-40b0-8295-05b0c69e8b5a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.239597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.240309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.240600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.240879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.241599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:20.241906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.243302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.259463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 488/986] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:20.260981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.311299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:20.370865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84934b-0223-4e01-97a6-cc93e68e4baa None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.405776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.406607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.406889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.407160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.414031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.415573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c49296fa-083f-4fb7-8e40-84e6e15643c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:20.429377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:20.430278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:20.431511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:20.434482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 499/987] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:20.436781 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.466567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:20.526623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b86e-ae37-426c-9244-ae7260e05b09 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.526946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b86e-ae37-426c-9244-ae7260e05b09 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.527195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b86e-ae37-426c-9244-ae7260e05b09 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.528713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 500/988] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:20.533317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.533608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.533891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.543910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a0fc-afc9-4946-826d-f0a637c2e5e6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.552938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:20.554132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:20.581286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.582546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.582925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.583336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.584122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:20.584437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.585873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.599858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 489/989] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:20.605800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.626995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 501/990] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:20.650486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.694066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:20.695833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:20.711898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9e6b5-6b4f-4a2c-bfbe-e50a2eb2e104 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.749291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.749957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.750801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.751092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.751943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] RBAC: Adding query filter params (role.id=d071b074106340aa8b8a137e7475350d, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=580d7a05a3cd412db56c0478b5b3842d) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:20.752261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.753751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.758087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783a52c-fde5-4784-9079-7d322fb05c0e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.766852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 490/991] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/role_assignments?user.id=580d7a05a3cd412db56c0478b5b3842d&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d071b074106340aa8b8a137e7475350d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:20.807474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:20.808330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:20.808760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:20.809177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:20.810204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:20.812420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:20.830230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:20.831444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:20.838397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 502/992] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:20.839288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:20.961953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4020677-d476-43ae-9020-650d551c5a5b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:20.999715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.000412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.000705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.000982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.001709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:21.002018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.003510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.010189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 491/993] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:21.016437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.119756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7220ab-0f3b-4244-a0fe-cdedee81a4c1 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.121252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.156170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.156848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.157356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.157811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.158854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:21.159189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.160813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8356e8-2dbe-4214-a0c7-c7dd8bc8d92c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.170734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 503/994] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:21.171955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.187727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add66-9f97-44e2-af61-1578ebef987f None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.188024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add66-9f97-44e2-af61-1578ebef987f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.188224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.188350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add66-9f97-44e2-af61-1578ebef987f None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.189781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 504/995] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:21.195506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.195797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.196079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.213719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:21.214931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:21.281067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a3ba-e22a-4d71-b3a5-c55fd1adee5f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.284920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 505/996] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:21.307127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.317558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.318215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.318545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.318820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.319615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] RBAC: Adding query filter params (interface=public, service_id=2f2a541b6415487eb81efdc1d0ec5029, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:21.319927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.321303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.331530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 492/997] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/endpoints?service_id=2f2a541b6415487eb81efdc1d0ec5029&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:21.332735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.412594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.415746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.418797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585b09-b793-4999-b88c-91831b587c2e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.437193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eaca2-7dd9-48e5-86e6-b156f4387fe6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.452988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.453806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.454098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.454380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.455079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.456461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:21.470286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:21.471522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:21.472410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 506/998] 10.222.0.74 () {56 vars in 1126 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:21.477729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.479747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.480443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.480726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.481004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.481760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.483610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.490305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 493/999] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:02:21.596436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f31bd-cdd7-47bf-98cc-b5c88d45b81f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.635757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.636450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.636741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.637025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.637741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:21.638054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.639464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.649895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 507/1000] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:21.655435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.759031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03377fb4-2026-4a31-841a-8ce8cb95a756 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.795209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.795897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.796182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.796460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.797172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:21.797515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.798906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74942c9-222d-4477-981e-58dc84dbb2b8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:21.806774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 494/1001] 10.222.0.74 () {56 vars in 1122 bytes} [Fri May 27 15:02:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:21.812443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:21.839473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.924171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59ddf-5700-46f1-892d-ab63365c3505 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:21.960178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:21.960841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:21.961129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:21.961404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:21.962151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:21.963546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e62470-781d-40d3-99bd-f15ca9c4ee87 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:22.081696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 508/1002] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:23.111661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2269-7011-4198-a10a-8e0a76c31c4c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.112175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2269-7011-4198-a10a-8e0a76c31c4c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.112175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2269-7011-4198-a10a-8e0a76c31c4c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.114100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 495/1003] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:23.119779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.120174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.120338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.137392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:23.138602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:23.220158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 509/1004] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:23.243088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe2269-7011-4198-a10a-8e0a76c31c4c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:23.252022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:23.345288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe2269-7011-4198-a10a-8e0a76c31c4c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:23.380060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:23.380852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.381135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.381410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.382056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:23.383450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:23.395368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:23.396438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:23.397285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:23.401377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 496/1005] 10.222.0.74 () {56 vars in 1105 bytes} [Fri May 27 15:02:23 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:23.402646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:23.415319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:23.506404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898c9e1-954b-4d81-9600-d8c6d58c7fd9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:23.541751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:23.542791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.543231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.543662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.544545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] RBAC: Adding query filter params (name=image) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:23.545054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:23.546671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c8a5-e8bd-4a29-83c5-fa7ecab30f17 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:23.553165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 510/1006] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:23.559462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:23.633688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:23.666278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2266f66-490f-46d1-9314-a15013f1aae2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:23.701334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:23.702034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.702313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.702604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.703307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] RBAC: Adding query filter params (type=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:23.703612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:23.705026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88daa5-f7b5-41b2-9f6c-20e0365a482e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:23.710376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 497/1007] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:23.735853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88ffa-7697-49ec-b466-41149812e0ce None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.736186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88ffa-7697-49ec-b466-41149812e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.736420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88ffa-7697-49ec-b466-41149812e0ce None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.738057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 511/1008] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:23.744051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:23.744393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:23.744618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:23.763431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:23.764575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:23.839260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 498/1009] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:23.862648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e88ffa-7697-49ec-b466-41149812e0ce None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:23.950765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:23.976375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e88ffa-7697-49ec-b466-41149812e0ce None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.011183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.011983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.012266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.012534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.013177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.014981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:24.026758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:24.027755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:24.028612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 512/1010] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:24.036681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:24.101478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:24.140790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e238820-3a01-40a1-9cde-d84a2c1c3a3f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.180543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.181215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.181496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.181772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.182502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:24.182809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.184186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151a1d-963a-48ad-9856-e8f457b77660 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.190520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 499/1011] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:24.196121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:24.301109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c420caa-31fd-4b88-ad28-06175a7a61e4 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.334588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.335252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.335536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.335812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.336508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:24.336813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.338170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.342308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867a9b1-e378-4247-bcc5-9c46f01afcb7 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.342645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867a9b1-e378-4247-bcc5-9c46f01afcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.342928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867a9b1-e378-4247-bcc5-9c46f01afcb7 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.347555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 513/1012] 10.222.0.74 () {56 vars in 1112 bytes} [Fri May 27 15:02:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:24.347689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 500/1013] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:24.348837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:24.349591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914485-838d-4697-bf76-869b071dc311 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.349887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914485-838d-4697-bf76-869b071dc311 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.350238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914485-838d-4697-bf76-869b071dc311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.351448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:24.368066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ab914485-838d-4697-bf76-869b071dc311 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:24.369270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab914485-838d-4697-bf76-869b071dc311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:24.446461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 501/1014] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:24.455470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58fab-6fde-4e02-9f86-a1174cb7242b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.466575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914485-838d-4697-bf76-869b071dc311 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:24.490598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709329-6c7a-419d-a738-ba639362238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.491262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709329-6c7a-419d-a738-ba639362238d None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.491541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709329-6c7a-419d-a738-ba639362238d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.491817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709329-6c7a-419d-a738-ba639362238d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.492547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47709329-6c7a-419d-a738-ba639362238d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.493906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47709329-6c7a-419d-a738-ba639362238d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.528655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:24.570342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914485-838d-4697-bf76-869b071dc311 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.606858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 514/1015] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:24.613747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.614612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.614894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.615174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.616493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.617975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968a9e-8862-46fc-82a5-62f4c4936dc9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.619900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 502/1016] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:24.625515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709329-6c7a-419d-a738-ba639362238d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:24.692313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:24.738602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709329-6c7a-419d-a738-ba639362238d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:24.776765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:24.777433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:24.777720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:24.777995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:24.778755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:24.780232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cff4b-877b-4912-91b5-ab0dc624f501 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:24.894978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 515/1017] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:24 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:26.086830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14313c-44af-4765-b0a2-042f464ccabf None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:26.087358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14313c-44af-4765-b0a2-042f464ccabf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:26.087438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14313c-44af-4765-b0a2-042f464ccabf None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:26.089006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 503/1018] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:26.094470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b51-fd43-462c-98bf-b65ec7046f90 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:26.094907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b51-fd43-462c-98bf-b65ec7046f90 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:26.095103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b51-fd43-462c-98bf-b65ec7046f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:26.111911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0e862b51-fd43-462c-98bf-b65ec7046f90 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:26.113696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0e862b51-fd43-462c-98bf-b65ec7046f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:26.190437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 516/1019] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:26 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:26.207281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14313c-44af-4765-b0a2-042f464ccabf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:26.309985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14313c-44af-4765-b0a2-042f464ccabf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:26.333356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:26.345069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:26.345744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:26.346027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:26.346306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:26.347067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:26.353283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c3a2-a8dd-4ec9-8e00-cea806ccb3f6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:26.464373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 504/1020] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:26 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:27.077927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5803-034c-410b-a0a5-bd2c7250b718 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.078251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5803-034c-410b-a0a5-bd2c7250b718 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.078515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5803-034c-410b-a0a5-bd2c7250b718 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.079933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 517/1021] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:27.085232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3537-19f4-4b16-bf74-14639a566f8e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.085523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3537-19f4-4b16-bf74-14639a566f8e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.085802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3537-19f4-4b16-bf74-14639a566f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.103262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dd1f3537-19f4-4b16-bf74-14639a566f8e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:27.104447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dd1f3537-19f4-4b16-bf74-14639a566f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:27.176681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 505/1022] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:27.200049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c5803-034c-410b-a0a5-bd2c7250b718 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.217869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f9cb-9f91-45b5-9c24-6d48c0827a78 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.218192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f9cb-9f91-45b5-9c24-6d48c0827a78 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.218461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f9cb-9f91-45b5-9c24-6d48c0827a78 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.220113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 506/1023] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:27.225025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.225355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.225588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.243433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:27.244613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:27.247409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:27.310052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c5803-034c-410b-a0a5-bd2c7250b718 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.322750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 507/1024] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:27.345496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.347026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.347898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.348271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.348564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.359971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:27.369438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:27.370387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:27.371418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 518/1025] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:27.376361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.391326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:27.454792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92a69-4a54-49c4-b985-fb14de37bf38 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.477554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:27.480784 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679bf7-4608-4a19-b5a3-e37ebacdfdcd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.492487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.493285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.493568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.493843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.495097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:27.496547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:27.502879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 508/1026] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:27.504006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.516780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.517624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.517912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.518192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.518973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:27.519785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:27.521286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:27.534101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 519/1027] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:27.535197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.619083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c21-faeb-44d7-a478-24ffcc6c449a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.627544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:27.642953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70916a9-cd0f-4a88-8c4c-d73582c2fac5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.656927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.657605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.657960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.658269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.658975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:27.660501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:27.684829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.685627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.685914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.686191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.697904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:27.699368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:27.716929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:27.718052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:27.719036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:27.719036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:27.719036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:27.719036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:27.719036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 520/1028] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:27.724365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:27.740766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:27.767761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 509/1029] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:02:27 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:27.836684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56277a-59d0-4e09-a1f4-2923a4fe0b62 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:27.875820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:27.876532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:27.876822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:27.877100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:27.877826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:27.878133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:27.879936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:27.893591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 521/1030] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:27.899757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.014269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d847-d9a4-4124-a3f0-38a42eaadf2e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.050280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66295746-7280-4f77-bedd-054716387b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:28.051766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295746-7280-4f77-bedd-054716387b03 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.052055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295746-7280-4f77-bedd-054716387b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.052330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295746-7280-4f77-bedd-054716387b03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.060125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66295746-7280-4f77-bedd-054716387b03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:28.061585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66295746-7280-4f77-bedd-054716387b03 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-66295746-7280-4f77-bedd-054716387b03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:28.076123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:28.077233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:28.078247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 510/1031] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:02:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:28.083642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.165963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:28.191068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a9d5-3fa0-45ba-896d-4b75ffa6469a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.227548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:28.228301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.228527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.228779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.229613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:28.229927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:28.231424 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:28.255780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 522/1032] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:28.257275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66295746-7280-4f77-bedd-054716387b03 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.287706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:28.367688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66295746-7280-4f77-bedd-054716387b03 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.403431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:28.404080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.404368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.404648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.477316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:28.478808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251db9e-2add-4d65-b3e2-a9339b1e4ddb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:28.501931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:28.589175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 511/1033] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 15:02:28.590285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.693968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522ed5-4e78-4bc4-b781-5199b18d334b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.724286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:28.729770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:28.730306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ef31-b91d-4124-af99-a10afbcae1df None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.730599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.730697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ef31-b91d-4124-af99-a10afbcae1df None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.730943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.731057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945ef31-b91d-4124-af99-a10afbcae1df None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.731209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.732542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 512/1034] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:28.737633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.738146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.739041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.742234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:28.743706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:28.756274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:28.757488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:28.761844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:28.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:28.763930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:28.763930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:28.763930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:28.763930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:28.763930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 523/1035] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:28.768850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.838689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 513/1036] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:28.861252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.874714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942000e1-0d20-467f-9947-9003bb79055f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.915992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:28.917119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:28.917415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:28.917701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:28.918832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:28.919145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:28.920534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:28.923749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:28.934187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 524/1037] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:28.939776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:28.971775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2b5c0-8da0-46cb-9b40-a016ca0bd4f3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:28.989559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:29.010992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.011789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.012071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.012345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] PATH_INFO: `/v3/services/image` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.012996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.014360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:29.027771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:29.028806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:29.029695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 514/1038] 10.222.0.74 () {56 vars in 1105 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:29.035115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.058833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37565-7bac-4c64-bae9-67194e247642 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.095480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.096280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.096572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.097280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.104967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.106432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:29.121585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:29.122591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:29.124373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 525/1039] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:29.128387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.149382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32503fa-ed0b-403e-acbc-b698d3599aab None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.166607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:29.185711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.186379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.186696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.186978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.187690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] RBAC: Adding query filter params (name=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:29.188002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.189380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.198948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 515/1040] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:29.199941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.240983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d07f1-80b7-4885-a6ab-0f47aa1d9d81 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.243434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:29.276403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.278004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.278291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.278602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.279399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:29.279714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.281155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.295019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 526/1041] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:29.301118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.307914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368eb-daab-4b68-9556-77b9d5b57108 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.344689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.345390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.345671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.345951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.346683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] RBAC: Adding query filter params (type=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:29.347101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.349023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.354261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 516/1042] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:29.359722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.408150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:29.408321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743b53-023b-4252-acd4-68ce37c02cc6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.444074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.444743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.445032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.445314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.446148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] RBAC: Adding query filter params (role.id=d071b074106340aa8b8a137e7475350d, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:29.446571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.447920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.462452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 527/1043] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d071b074106340aa8b8a137e7475350d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:29.478297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ca52-2301-4660-b324-b73603f55763 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.516669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.517357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.517645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.517922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.518784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] RBAC: Adding query filter params (interface=public, service_id=80823a6eb9f849298d6c50d7bc4ac25b, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:29.519101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.520700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfa60-9bdf-4f64-b884-3b843b0578a1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.526751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 517/1044] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/endpoints?service_id=80823a6eb9f849298d6c50d7bc4ac25b&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:29.532351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:29.565027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:29.644818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d539d-7c18-4f51-bc4e-130a0199da51 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:29.685478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:29.686437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:29.686904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:29.687351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:29.688187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:29.689703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e9f1-2fbe-41e4-be32-9191f2ebf579 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:29.697576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 528/1045] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:02:29 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:02:30.143765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f134-3a66-421b-9c5c-49d27c4ba7d5 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.144357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f134-3a66-421b-9c5c-49d27c4ba7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.145032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f134-3a66-421b-9c5c-49d27c4ba7d5 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.146089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 518/1046] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:30.151419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.151716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.151996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.169282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:30.170502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:30.243389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 529/1047] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:30.267082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100f134-3a66-421b-9c5c-49d27c4ba7d5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:30.371800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100f134-3a66-421b-9c5c-49d27c4ba7d5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:30.381189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:30.406339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:30.407091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.407377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.407654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.418998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:30.426756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:30.427711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:30.428559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:30.430726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 519/1048] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:30.433865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:30.458589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:30.535651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2dbb4-1bcf-437d-a287-4bbdfdccb543 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:30.569752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:30.570460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.570748 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.571022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.571770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:30.572076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:30.573441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:30.587526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 530/1049] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:30.588988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:30.693162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083dcb2-fc98-4eee-b166-ec06ac213eb6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:30.726350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:30.727252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.727539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.727814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] PATH_INFO: `/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.741070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d8d7fcf07445ab84e4d1f95b65e1e2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:30.742547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:30.744372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 520/1050] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:30 2022] GET /identity/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:30.749872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:30.839341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:30.855657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d612a-8d1e-42ba-b3d4-60cfd60c2a8d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:30.896036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:30.897038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:30.897552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:30.898031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:30.968844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:30.970270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:31.053365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:31.075022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 531/1051] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:31.075961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:31.103732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:31.178401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedcda-7ff8-4d28-a199-55e11a6932f2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:31.213114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:31.213979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.214263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.214565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.215746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:31.217191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef33eaf-0df9-40ed-9a5e-dec187670bb6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:31.219142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 521/1052] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:31 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:31.225084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:31.327226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee982-b948-4aa5-bd1b-d71e07b2cb71 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:31.361062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:31.361726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.362009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.362286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.363688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=9b381d5bb7ca481a8478d8a275174072, user.id=d3d8d7fcf07445ab84e4d1f95b65e1e2) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:31.364003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:31.365429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef44a9-222a-4ea8-a0eb-acfea77ee238 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:31.378690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 532/1053] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:31 2022] GET /identity/v3/role_assignments?user.id=d3d8d7fcf07445ab84e4d1f95b65e1e2&scope.project.id=9b381d5bb7ca481a8478d8a275174072&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:31.680561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19a68-4ea7-4f55-a40b-7e440f07140c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.681066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19a68-4ea7-4f55-a40b-7e440f07140c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.681145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19a68-4ea7-4f55-a40b-7e440f07140c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.682572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 522/1054] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:31.687760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105b17-ad95-4eb3-9665-9d32e780e5d2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.688059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105b17-ad95-4eb3-9665-9d32e780e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.688340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105b17-ad95-4eb3-9665-9d32e780e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.709471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4a105b17-ad95-4eb3-9665-9d32e780e5d2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:31.710710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4a105b17-ad95-4eb3-9665-9d32e780e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:31.762071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:31.787768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 533/1055] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:31.811565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb19a68-4ea7-4f55-a40b-7e440f07140c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:31.919678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:31.927364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb19a68-4ea7-4f55-a40b-7e440f07140c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:31.934332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778dd6-78a9-47e8-a3af-27efe8970524 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.934332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778dd6-78a9-47e8-a3af-27efe8970524 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.934332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778dd6-78a9-47e8-a3af-27efe8970524 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.934332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 534/1056] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:31.938906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.939204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.939515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.956399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:31.958249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:31.963431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:31.964434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:31.964860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:31.965288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:31.975859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:31.984176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:31.985308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:31.986475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:31.989354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 523/1057] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:31.994786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.030888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 535/1058] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:32.056013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.102300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3755-4d7b-46ed-8603-5a2ecb8cef4b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.138526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.139546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.139837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.140379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.141125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:32.141429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.143132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.151400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 524/1059] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:32.156988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.169132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33d692-23c3-41ae-aff9-cde742211abf None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.175447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.180472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.209143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.209857 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.210138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.210428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] PATH_INFO: `/v3/services/image` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.211084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.212495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:32.225065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:32.226113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:32.227034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 536/1060] 10.222.0.74 () {56 vars in 1105 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:32.232411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.264123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b6b1-f96a-43cb-b94f-dd5b5b1db895 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.303856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.304656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.304943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.305222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.315635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.317119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:32.337100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:32.338227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:32.339471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:32.339471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:32.339471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:32.339471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:32.339471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 525/1061] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:32.343885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.345029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917a91b-72d8-429d-8488-5f9768501f4d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.381192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.382763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.383061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.383345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.384104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:32.384422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.385803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.392644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 537/1062] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:32.397905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.419672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.434782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.456422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c101d-ae08-407c-af3a-c6fb7974097b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.498939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.499529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.499815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.500094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.500818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:32.501127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.502514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.507246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999baff-556a-4988-9aa5-556d3f48edf5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.518779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 526/1063] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:32.519796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.549829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.550596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.551544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.551835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.552550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] RBAC: Adding query filter params (type=image) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:32.552864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.554247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.559263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 538/1064] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:32.564945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.636752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea520dd-f2ec-493a-b541-2c552f2062bc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.666485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.674402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.675225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.675368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:32.675546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.676139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.678907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11529-8fbf-4faa-aed2-62f67c66c60d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.683465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.684924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:32.699269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:32.703127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:32.704318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 527/1065] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:32.706269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:32.719837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.729210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.729210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.729210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.729210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.729210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.796421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 539/1066] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:02:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:02:32.812664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c50-84fe-406e-8ed7-5694b9d01ac0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:32.861616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:32.862312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:32.862624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:32.862898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:32.864360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:32.864680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:32.866173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:32.892416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 528/1067] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:32.898165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.019202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3dfef-e3ea-471c-9aea-f16cce0e8ba9 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.055554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.056273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.056612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.056894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.067836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:33.069278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:33.087875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:33.088842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:33.094443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:33.094443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:33.094443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:33.094443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:33.094443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 540/1068] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:33.096165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.141232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.200502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8633f1-2225-4e4f-a8df-1679a68370a0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.235345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.236012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.236294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.236571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.237285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:33.237592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:33.239018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:33.255286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 529/1069] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:33.256851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.268109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.360724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a025e38-47a6-4743-9f61-f4af3fa9211e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.398903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.399726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.400012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.400287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.407974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:33.409434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c14584a6-522a-4d02-844d-3c620245392f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:33.424357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:33.425286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:33.430891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 541/1070] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:33.432864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.533165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e281a-1b95-4f23-bc9b-6e65d39911af None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.534774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.568178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3705b-9cd3-4d9d-b82b-cab67ef03e74 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.568559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3705b-9cd3-4d9d-b82b-cab67ef03e74 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.568840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3705b-9cd3-4d9d-b82b-cab67ef03e74 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.569086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.569753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.570033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.573749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.573866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 542/1071] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:33.573946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:33.573946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:33.573946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:33.576016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64231-502c-47ad-8397-36705b495179 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.576307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64231-502c-47ad-8397-36705b495179 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.576624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64231-502c-47ad-8397-36705b495179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.585480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 530/1072] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:33.591549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.595944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bce64231-502c-47ad-8397-36705b495179 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:33.597127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bce64231-502c-47ad-8397-36705b495179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:33.665571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.671590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 543/1073] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:33.695108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce64231-502c-47ad-8397-36705b495179 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.698424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059318c-1349-44a9-ae0a-a1d740aa63c5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.733556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.734600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.734888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.735169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/d071b074106340aa8b8a137e7475350d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.737442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=4af65d40347141eebeb01eb446f93766, role_id=d071b074106340aa8b8a137e7475350d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:33.739611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:33.798367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce64231-502c-47ad-8397-36705b495179 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:33.822447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 531/1074] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:02:33 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/4af65d40347141eebeb01eb446f93766/roles/d071b074106340aa8b8a137e7475350d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:02:33.848382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:33.849282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:33.849563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:33.849833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:33.862008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:33.869915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:33.871157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:33.872558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 544/1075] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:33.880460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:33.908293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.992908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c4b1-b7b5-414f-9012-41126c9bbd95 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:34.035602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:34.036360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:34.036651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:34.036930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:34.037689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:34.038000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:34.039421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:34.048693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 532/1076] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:34.055194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:34.116918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:34.159598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950f00-c88f-4e2c-ad94-057b5ef1fae3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:34.193830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:34.194738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:34.195028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:34.195305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] PATH_INFO: `/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:34.196491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d8d7fcf07445ab84e4d1f95b65e1e2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:34.197925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:34.199756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 545/1077] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:34 2022] GET /identity/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:34.205533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:34.291890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:34.307346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11dea-51fc-41ef-b123-67bf950a2b5b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:34.341124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:34.341988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:34.342266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:34.342573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:34.343739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:34.345170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af854-80db-4ea5-9f41-d621d9e5284e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:34.350487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 533/1078] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:34 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:34.353453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:34.457766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f82f-8bd3-48cb-9241-3d61010d7f50 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:34.485044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:34.494375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:34.499461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:34.499461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:34.499461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072/users/d3d8d7fcf07445ab84e4d1f95b65e1e2/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:34.499461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] RBAC: Authorizing `identity:create_grant(project_id=9b381d5bb7ca481a8478d8a275174072, user_id=d3d8d7fcf07445ab84e4d1f95b65e1e2, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:34.499461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62085ccb-7a0e-4178-a290-b2b8b6f0160b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:34.576476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 546/1079] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:02:34 2022] PUT /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072/users/d3d8d7fcf07445ab84e4d1f95b65e1e2/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:02:35.059506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173560cc-8239-4412-8491-e8c0a20a01a7 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:35.060022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173560cc-8239-4412-8491-e8c0a20a01a7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:35.060101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173560cc-8239-4412-8491-e8c0a20a01a7 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:35.061620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 534/1080] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:35.067318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:35.067318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:35.068054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:35.084906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:35.086102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:35.156309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 547/1081] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:35.178823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173560cc-8239-4412-8491-e8c0a20a01a7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:35.283399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173560cc-8239-4412-8491-e8c0a20a01a7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:35.318931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:35.319582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:35.319866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:35.320143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:35.341094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:35.388380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:35.389850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:35.487837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 535/1082] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:35.493517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:35.592279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115cd0-d0f5-4411-bb99-3dbc84d09e40 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:35.609274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:35.628018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:35.628881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:35.629166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:35.629446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:35.640835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:35.642288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-5ebf1945-7f2d-477c-80d9-6a39b4067d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:35.661379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:35.662359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:35.663375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:35.663375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:35.663375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:35.663375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:35.664186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 548/1083] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:35.668633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:35.726191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:35.775505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cfd8-de88-4a0f-a011-695d72320652 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:35.808892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:35.809580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:35.809865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:35.810137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:35.810885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:35.811191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:35.812550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d623e57-5837-4d2f-8852-65a5c344bab1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:35.830453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 536/1084] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:36.113785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c30d-5b3b-424f-a80b-4393ebdd191b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.114734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c30d-5b3b-424f-a80b-4393ebdd191b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.115028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c30d-5b3b-424f-a80b-4393ebdd191b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.116597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 549/1085] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:36.121931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.122366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.122577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.139471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:36.140910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:36.210031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 537/1086] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:36.234171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c30d-5b3b-424f-a80b-4393ebdd191b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.343077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c30d-5b3b-424f-a80b-4393ebdd191b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:36.377226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:36.377971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.378256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.378572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.388710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:36.398030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:36.399235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:36.400201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 550/1087] 10.222.0.74 () {56 vars in 1120 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:36.405498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.447846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:36.503762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a985-285c-44af-9acd-f72842345fe4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:36.539056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:36.539724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.540008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.540285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.541026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:36.541335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:36.542750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:36.550454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 538/1088] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:36.556637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.587460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:36.668826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f64647-e1fe-4eb0-9510-034f7331e4db None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:36.702676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:36.703465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.703745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.704020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.714788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:36.716222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-34f2b02a-e3ff-490c-9d78-f93035bce586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:36.733217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:36.734197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:36.735664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:36.735664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:36.735664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:36.735664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:36.735664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 551/1089] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:36.740283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.795265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270007-d3b9-45e0-84c6-e26cecbc761a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.795547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270007-d3b9-45e0-84c6-e26cecbc761a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.795831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270007-d3b9-45e0-84c6-e26cecbc761a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.797205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 552/1090] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:02:36.802276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.802615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.802900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.819826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:36.821015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:36.840010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da6b2-9a3a-435a-ad1a-1f36f1365c39 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:36.842335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:36.873711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:36.874372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:36.874690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:36.874969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:36.875685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:36.875994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:36.877361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:36.889416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 539/1091] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:36.898236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 553/1092] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 15:02:36.898403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.917139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:36.929158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.000326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab909c5-b006-4b81-a9c9-e6b4604852cb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.019196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b7ffd-99fd-4035-8978-ff8656157375 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.035129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.035914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.036202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.036483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.043903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.045348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.053962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.054782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.055072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.055346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:02:37.059745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:37.060728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:37.061721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 540/1093] 10.222.0.74 () {56 vars in 1093 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:37.065817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:37.067195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:37.074444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:37.075408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:37.077551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 554/1094] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:37.081243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.095723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.150226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.173145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130fd8-07dd-4162-82bd-a4fb757e02ea None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.182926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7f85b-aaf4-4d8e-8435-74dbbbb46b4b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.208906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.209576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.209861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.210141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.211003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:37.211353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.212785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.216462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.217120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.217467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.217753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.218511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:37.218820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.220183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.230190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 541/1095] 10.222.0.74 () {56 vars in 1133 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:37.231569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 555/1096] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:37.237158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.239417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.321117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.338499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988f24e-725a-4c32-b4c6-915e558c8017 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.341139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8894-8b94-4490-8c11-f31d2a523f76 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.370215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.372224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.373085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.373366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.373639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] PATH_INFO: `/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.374837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d8d7fcf07445ab84e4d1f95b65e1e2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.380446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.380446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.380658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.380752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.380752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.380915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 542/1097] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/users/d3d8d7fcf07445ab84e4d1f95b65e1e2 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:37.384145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.446998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.448364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.481937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbad02f-514f-44ce-87d4-27b19255dc15 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.516174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.516817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.517104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.517380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.537007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.548206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 556/1098] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 15:02:37.555296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.584856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.598898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.600845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.652930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22d51-f18f-4a5f-be3d-f8a76641d4a7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.686933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.687724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.688006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.688280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.698458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.699699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 543/1099] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:37.699852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.707286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:02:37.717500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:37.718453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:37.719381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:02:37.719381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:02:37.719381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:02:37.719381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:37.719381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 557/1100] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:37.725018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.756269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.806850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861668dc-3de2-4a92-9f7d-bc9246de73ea None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.810990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.827025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3b33-0802-4cde-8496-de58f013feb7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.842703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.843556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.843842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.844126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.845294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.846754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.849607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 544/1101] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:37.856365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.864144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.864542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.864827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.865103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.865828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:37.866138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.867612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:37.880127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 558/1102] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:37.885822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:37.961512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64e15b-d382-489c-8bad-195db2f36a26 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.978218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:37.987467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f9cf-624a-460a-ab97-77bffd11a9ba None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:37.994645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:37.995297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:37.995579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:37.995852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:37.996671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=9b381d5bb7ca481a8478d8a275174072, user.id=d3d8d7fcf07445ab84e4d1f95b65e1e2) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:37.996977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:37.998429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:38.004779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 545/1103] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/role_assignments?user.id=d3d8d7fcf07445ab84e4d1f95b65e1e2&scope.project.id=9b381d5bb7ca481a8478d8a275174072&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:02:38.023407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:38.024236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:38.024521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:38.024798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:38.032543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:38.034037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:02:38.049774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:38.051455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:02:38.052544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 559/1104] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:02:38.058155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:38.170791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06851-b73c-45e6-be8c-ee89ff42ad94 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:38.208565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:38.209212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:38.209502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:38.209781 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:38.210694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:38.211008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:38.212519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8f89-ae63-4a45-8c65-006b46a5ac2a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:38.226091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 546/1105] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:38.232491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:38.236373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:38.331431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408662-600d-4da5-874a-316dc711b245 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:38.365503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:38.366159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:38.366473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:38.366756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:38.367587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] RBAC: Adding query filter params (role.id=d071b074106340aa8b8a137e7475350d, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=4af65d40347141eebeb01eb446f93766) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:38.367906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:38.369344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f187b-0eff-4e39-acfe-59ff485df373 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:38.375294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 560/1106] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:38 2022] GET /identity/v3/role_assignments?user.id=4af65d40347141eebeb01eb446f93766&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d071b074106340aa8b8a137e7475350d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:40.234232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731c3d-1d90-4f9b-928a-b328d613e39d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:40.234819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731c3d-1d90-4f9b-928a-b328d613e39d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:40.234819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731c3d-1d90-4f9b-928a-b328d613e39d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:40.236190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 547/1107] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:40.241980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:40.242382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:40.242686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:40.259582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:40.260762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:40.320244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:40.325422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 561/1108] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:40.350368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731c3d-1d90-4f9b-928a-b328d613e39d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:40.394142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:40.448792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731c3d-1d90-4f9b-928a-b328d613e39d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:40.481366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:40.482139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:40.482443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:40.482725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:40.483883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:40.485364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87da6a-92d3-4ef8-884b-bb32d201e91b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:40.486940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 548/1109] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:40.493086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:40.588801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f3c2-c379-443a-b4d9-b01116baaeca None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:40.622607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:40.623266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:40.623553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:40.623833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:40.624542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:40.625970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7805904-8fab-4502-938d-f388d9cf7fdf None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:40.730191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 562/1110] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:02:40 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:42.990051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39480c-682e-4eec-acf9-fb791f2b8428 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:42.990583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39480c-682e-4eec-acf9-fb791f2b8428 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:42.990677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39480c-682e-4eec-acf9-fb791f2b8428 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:42.991991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 549/1111] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:42.997142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:42.997510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:42.997697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.014154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:43.015623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:43.063703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:43.080253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 563/1112] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:43.104100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39480c-682e-4eec-acf9-fb791f2b8428 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:43.205484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39480c-682e-4eec-acf9-fb791f2b8428 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:43.216717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:43.240486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:43.241337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:43.241619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:43.241894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] PATH_INFO: `/v3/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.243371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] RBAC: Authorizing `identity:get_role(role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:43.244738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:43.246090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 550/1113] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:43 2022] GET /identity/v3/roles/018279cf41c14fa5b5d2a962378262e8 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:43.251811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:43.351223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a1aca-6490-4f77-945a-a43b24c9fbc4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:43.384337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:43.385210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:43.385497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:43.385772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] PATH_INFO: `/v3/users/932f74ad8ac44976bb3a94e6444d554f` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.400503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=932f74ad8ac44976bb3a94e6444d554f)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:43.401926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:43.403582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 564/1114] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:43 2022] GET /identity/v3/users/932f74ad8ac44976bb3a94e6444d554f => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:43.409223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:43.509936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a746c-d45a-40e2-9531-7cf404674478 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:43.543859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:43.544492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:43.544775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:43.545052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.591051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:43.611759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:43.613715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:43.711944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 551/1115] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:43.717808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:43.760076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:43.815068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387416-354c-44e9-9992-01b6ca422ee6 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:43.847607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:43.848457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:43.848741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:43.849017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.850174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:43.851632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a929-6178-40e8-92ff-796b3ca9c64f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:43.853317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 565/1116] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:43 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:43.859465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:43.937144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:43.959186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52051c45-8344-4b01-b342-2fe0d091a349 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:43.994440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:43.995094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:43.995376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:43.995651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:43.996472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=9b381d5bb7ca481a8478d8a275174072, user.id=932f74ad8ac44976bb3a94e6444d554f) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:43.996784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:43.998231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced2a5-559f-4286-86e3-2781d204fa5d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:44.003688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 552/1117] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:43 2022] GET /identity/v3/role_assignments?user.id=932f74ad8ac44976bb3a94e6444d554f&scope.project.id=9b381d5bb7ca481a8478d8a275174072&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:46.233879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3f1c-6b25-4c23-870b-7a54660fa5bd None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.234446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3f1c-6b25-4c23-870b-7a54660fa5bd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.234446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa3f1c-6b25-4c23-870b-7a54660fa5bd None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.235825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 566/1118] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:46.241272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.241673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.241824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.257993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:46.259230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:46.323371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 553/1119] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:46.345940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa3f1c-6b25-4c23-870b-7a54660fa5bd None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:46.453136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa3f1c-6b25-4c23-870b-7a54660fa5bd None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:46.464583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:46.487325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:46.488242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.488532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.488811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] PATH_INFO: `/v3/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.490363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] RBAC: Authorizing `identity:get_role(role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:46.491759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:46.493319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 567/1120] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:46 2022] GET /identity/v3/roles/018279cf41c14fa5b5d2a962378262e8 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:46.498997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:46.574114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:46.607793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8d2f-c9ad-4a8c-85ce-6a7ae9569be6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:46.644161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:46.646205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.646512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.646789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] PATH_INFO: `/v3/users/932f74ad8ac44976bb3a94e6444d554f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.648070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] RBAC: Authorizing `identity:get_user(user_id=932f74ad8ac44976bb3a94e6444d554f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:46.649528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:46.651226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 554/1121] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:46 2022] GET /identity/v3/users/932f74ad8ac44976bb3a94e6444d554f => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:46.656972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:46.755690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47ece-6a0e-4081-a3d1-ec867da2f76d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:46.789018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:46.789870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.790156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.790457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.791625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:46.793057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4381d-0f59-48c7-bcbc-733843487e17 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:46.794775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 568/1122] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:46 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:46.800684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:46.898077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b2b2-653d-4799-a1a4-13f4976081d7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:46.932609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:46.933496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:46.933779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:46.934054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072/users/932f74ad8ac44976bb3a94e6444d554f/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:46.936253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] RBAC: Authorizing `identity:create_grant(project_id=9b381d5bb7ca481a8478d8a275174072, user_id=932f74ad8ac44976bb3a94e6444d554f, role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:46.937677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072492e-e769-4c67-b60d-8af8e812ad0a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:46.996294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:47.000659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 555/1123] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:02:46 2022] PUT /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072/users/932f74ad8ac44976bb3a94e6444d554f/roles/018279cf41c14fa5b5d2a962378262e8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:02:49.171421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a758-f103-4e3a-8f8b-42caf26b5187 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:49.171945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a758-f103-4e3a-8f8b-42caf26b5187 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:49.171945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a758-f103-4e3a-8f8b-42caf26b5187 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:49.173318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 569/1124] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:49.179904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:49.180330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:49.180457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:49.197256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:49.198454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:49.262289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 556/1125] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:49.285301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5a758-f103-4e3a-8f8b-42caf26b5187 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:49.332393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:49.384810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5a758-f103-4e3a-8f8b-42caf26b5187 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:49.417169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549150-b426-4521-addf-7f4db201c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:49.418009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549150-b426-4521-addf-7f4db201c980 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:49.418289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549150-b426-4521-addf-7f4db201c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:49.418592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549150-b426-4521-addf-7f4db201c980 None admin] PATH_INFO: `/v3/roles/018279cf41c14fa5b5d2a962378262e8` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:49.420072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549150-b426-4521-addf-7f4db201c980 None admin] RBAC: Authorizing `identity:get_role(role_id=018279cf41c14fa5b5d2a962378262e8)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:49.421482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549150-b426-4521-addf-7f4db201c980 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:49.422813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 570/1126] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:49 2022] GET /identity/v3/roles/018279cf41c14fa5b5d2a962378262e8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:49.429182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:49.524312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a2e6e-7da5-492f-9fca-3d7875e3e355 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:49.552532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:49.558137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:49.559043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:49.559328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:49.559604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] PATH_INFO: `/v3/users/932f74ad8ac44976bb3a94e6444d554f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:49.561741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] RBAC: Authorizing `identity:get_user(user_id=932f74ad8ac44976bb3a94e6444d554f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:49.562205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:49.563908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 557/1127] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:49 2022] GET /identity/v3/users/932f74ad8ac44976bb3a94e6444d554f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:49.569938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549150-b426-4521-addf-7f4db201c980 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:49.667540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549150-b426-4521-addf-7f4db201c980 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:49.681231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:49.700900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:49.701540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:49.701827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:49.702109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:49.767738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:49.769167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:49.864780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 571/1128] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:49.870824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:49.968592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102f47-240e-45e4-9397-73ec2812294e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:50.001427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:50.002265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:50.002577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:50.002850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] PATH_INFO: `/v3/projects/9b381d5bb7ca481a8478d8a275174072` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:50.004096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] RBAC: Authorizing `identity:get_project(project_id=9b381d5bb7ca481a8478d8a275174072)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:50.005516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad450f33-33ad-4a0e-b72f-bccf3c136a81 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:50.007218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 558/1129] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:49 2022] GET /identity/v3/projects/9b381d5bb7ca481a8478d8a275174072 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:50.013371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:50.028807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:50.110371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672220f-d737-4a40-ac5d-053a4255e611 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:50.142836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:50.143481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:50.143764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:50.144041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:50.145758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] RBAC: Adding query filter params (role.id=018279cf41c14fa5b5d2a962378262e8, scope.project.id=9b381d5bb7ca481a8478d8a275174072, user.id=932f74ad8ac44976bb3a94e6444d554f) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:50.146073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:50.147536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ea5b-07da-4601-b95d-d21fdf556f72 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:50.153165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 572/1130] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:50 2022] GET /identity/v3/role_assignments?user.id=932f74ad8ac44976bb3a94e6444d554f&scope.project.id=9b381d5bb7ca481a8478d8a275174072&role.id=018279cf41c14fa5b5d2a962378262e8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:52.430460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0be333-9ce3-4fa6-a187-11a73c212c8d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:52.431025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0be333-9ce3-4fa6-a187-11a73c212c8d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:52.431025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0be333-9ce3-4fa6-a187-11a73c212c8d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:52.432372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 559/1131] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:52.437805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:52.438252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:52.438366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:52.455587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:52.457392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:52.523084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 573/1132] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:52.545751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0be333-9ce3-4fa6-a187-11a73c212c8d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:52.617655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:52.652421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0be333-9ce3-4fa6-a187-11a73c212c8d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:52.685689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:52.686434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:52.686716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:52.686991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:52.688160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:52.689596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d055-7925-406d-a57f-5fdd55e5898b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:52.691964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 560/1133] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:52.697896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:52.708637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:52.794089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad9b4-4f9e-4b76-9a3c-13d6b217e6ad None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:52.826994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:52.827640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:52.827922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:52.828196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:52.828890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:52.830302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951818da-7d76-4a9e-a804-bddf494d5f33 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:52.945986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 574/1134] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:02:52 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:55.145443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7bfa9-7e22-43c9-8a6f-6190ca13c42f None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:55.145967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7bfa9-7e22-43c9-8a6f-6190ca13c42f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:55.145967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7bfa9-7e22-43c9-8a6f-6190ca13c42f None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:55.147429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 561/1135] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:55.152869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:55.153280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:55.153435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:55.171037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:55.172223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:55.228221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:55.239769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 575/1136] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:55.264604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7bfa9-7e22-43c9-8a6f-6190ca13c42f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:55.364189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7bfa9-7e22-43c9-8a6f-6190ca13c42f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:55.397059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:55.397828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:55.398120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:55.398397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:55.399586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:55.401023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea295-f9b9-4977-a5b3-9158e57bac43 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:55.402653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 562/1137] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:55.408215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:55.502680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46453f-c2e4-4131-ab3d-6b6ec8262166 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:55.535916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:55.536766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:55.537055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:55.537330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:55.538021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:55.539469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc26329-90b5-47c0-b0f4-f0b0f7110423 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:55.643640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 576/1138] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:02:55 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:02:57.885826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1afb-30b9-4abb-93ed-3f4fb2c27c4d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:57.886395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1afb-30b9-4abb-93ed-3f4fb2c27c4d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:57.886395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1afb-30b9-4abb-93ed-3f4fb2c27c4d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:57.887785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 563/1139] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:02:57.893168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:57.893573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:57.893719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:57.911612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:02:57.912794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:02:57.953631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:57.977381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 577/1140] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:02:58.001149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded1afb-30b9-4abb-93ed-3f4fb2c27c4d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.004070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:58.102360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded1afb-30b9-4abb-93ed-3f4fb2c27c4d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:58.135472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:58.136292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:58.136524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:58.136797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:58.146788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:02:58.154334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:02:58.155466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:02:58.156749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 564/1141] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:02:58.161457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.256560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc2100-5919-42bc-b4c3-8ae314d76413 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:58.288562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:58.289216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:58.289498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:58.289771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:58.290528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:58.290837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:58.292189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:58.299901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 578/1142] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:58.306098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.366175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:58.404058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647448e6-a966-49fd-a10b-a6b67ee46c11 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:58.436219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:58.437071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:58.437352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:58.437625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] PATH_INFO: `/v3/users/ceb1c54bca4f461db625099a85533d11` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:58.450886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb1c54bca4f461db625099a85533d11)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:58.452328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:58.453956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 565/1143] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/users/ceb1c54bca4f461db625099a85533d11 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:58.460126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.498546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:58.558032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ea53-6943-426d-b582-4a340d8375e7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:58.591459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:58.592099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:58.592387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:58.592668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:58.657659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:58.659082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:58.697932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:58.754654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 579/1144] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:02:58.761336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.857124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a11b-85aa-45af-9598-4f172c469f17 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:58.876377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:58.890094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:58.891249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:58.891531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:58.891806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] PATH_INFO: `/v3/projects/92b5267b6ff54c2dae82242ce416af00` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:58.892986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] RBAC: Authorizing `identity:get_project(project_id=92b5267b6ff54c2dae82242ce416af00)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:58.894420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c13cb-beec-46f1-990f-89e56fce31d1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:58.896216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 566/1145] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/projects/92b5267b6ff54c2dae82242ce416af00 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:02:58.902144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:02:58.999022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31635-fbf9-4c52-b39b-ac4e038b8fff None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:02:59.031657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:02:59.032298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:02:59.032578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:02:59.032851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:02:59.033662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=92b5267b6ff54c2dae82242ce416af00, user.id=ceb1c54bca4f461db625099a85533d11) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:02:59.033968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:02:59.035405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946d0e8-8d79-4a81-a9f7-ecd79c070cad None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:02:59.040679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 580/1146] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:02:58 2022] GET /identity/v3/role_assignments?user.id=ceb1c54bca4f461db625099a85533d11&scope.project.id=92b5267b6ff54c2dae82242ce416af00&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:01.210994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f6b-c61b-4b98-a9f5-b8e20a62fbda None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.211531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f6b-c61b-4b98-a9f5-b8e20a62fbda None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.211626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f6b-c61b-4b98-a9f5-b8e20a62fbda None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.212946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 567/1147] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:01.218211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.218741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.218844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.223752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:01.236315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:01.237527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:01.303676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 581/1148] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:01.326649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db0f6b-c61b-4b98-a9f5-b8e20a62fbda None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:01.426372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db0f6b-c61b-4b98-a9f5-b8e20a62fbda None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:01.459342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:01.460120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.460405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.460684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.470534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:03:01.478606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:01.479541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:03:01.480424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 568/1149] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:01.485586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:01.581437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40bc0e-ec3e-4eff-884b-7679ae7879ca None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:01.609605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:01.614933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:01.619674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:01.626718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 582/1150] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:01.632671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:01.682186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:01.732628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d0f9b-51bf-4f72-b358-6fd882d30617 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:01.765468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:01.766620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.766910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.767185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] PATH_INFO: `/v3/users/ceb1c54bca4f461db625099a85533d11` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.768370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb1c54bca4f461db625099a85533d11)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:01.769820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:01.771968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 569/1151] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:03:01 2022] GET /identity/v3/users/ceb1c54bca4f461db625099a85533d11 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:01.777679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:01.875260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ecc9-6dbf-4f17-a19e-31e074d9a2f2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:01.910935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:01.912472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:01.912761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:01.913037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] PATH_INFO: `/v3/projects/92b5267b6ff54c2dae82242ce416af00` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:01.914197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] RBAC: Authorizing `identity:get_project(project_id=92b5267b6ff54c2dae82242ce416af00)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:01.915675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1ea96-8842-4ec4-8aba-ee6c735e7a05 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:01.917358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 583/1152] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:03:01 2022] GET /identity/v3/projects/92b5267b6ff54c2dae82242ce416af00 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:01.923231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:02.018877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb75b6e-f5c1-4f19-b519-da01cabd01d9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:02.034339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:02.052689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:02.053572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:02.058442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:02.058442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] PATH_INFO: `/v3/projects/92b5267b6ff54c2dae82242ce416af00/users/ceb1c54bca4f461db625099a85533d11/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:02.058442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] RBAC: Authorizing `identity:create_grant(project_id=92b5267b6ff54c2dae82242ce416af00, user_id=ceb1c54bca4f461db625099a85533d11, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:02.058442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c691f2a-6751-4488-bb33-b6305e0674fd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:02.126041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 570/1153] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:03:01 2022] PUT /identity/v3/projects/92b5267b6ff54c2dae82242ce416af00/users/ceb1c54bca4f461db625099a85533d11/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:03:04.263366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9429-27ed-45d3-b14d-cfff116063c8 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.263890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9429-27ed-45d3-b14d-cfff116063c8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.264000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9429-27ed-45d3-b14d-cfff116063c8 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:04.265287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 584/1154] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:04.271415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.271831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.271975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:04.288975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:04.290181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:04.355404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 571/1155] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:04.379055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9429-27ed-45d3-b14d-cfff116063c8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:04.440245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:04.478233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9429-27ed-45d3-b14d-cfff116063c8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:04.510922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:04.511696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.511977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.512251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:04.522982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:03:04.530541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:04.531712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:03:04.532763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 585/1156] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:04.538232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:04.633455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938f7e-47a0-4040-871c-989ea8bc6653 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:04.640512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:04.666820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:04.667481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.667768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.668047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:04.668808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:04.669306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:04.671044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:04.679274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 572/1157] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:04.685155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:04.785949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dc267-22f9-4c90-9218-dac814b024a7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:04.807975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:04.819358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:04.820224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.820507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.822575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] PATH_INFO: `/v3/users/ceb1c54bca4f461db625099a85533d11` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:04.822575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb1c54bca4f461db625099a85533d11)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:04.823364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:04.824978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 586/1158] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:03:04 2022] GET /identity/v3/users/ceb1c54bca4f461db625099a85533d11 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:04.830924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:04.931444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1d18-19ff-4882-8c7e-65f6faa4fa68 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:04.965297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:04.965938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:04.966222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:04.966526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:05.001410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:05.034069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:05.035537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:05.132467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 573/1159] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:03:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:03:05.138325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:05.238376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b99a6-c1f7-4bbf-b43b-6f22c1148222 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:05.272045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:05.272897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:05.273181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:05.273458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] PATH_INFO: `/v3/projects/92b5267b6ff54c2dae82242ce416af00` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:05.274641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] RBAC: Authorizing `identity:get_project(project_id=92b5267b6ff54c2dae82242ce416af00)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:05.276062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb786c6-ab5f-4de5-9cf8-9fce62a4face None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:05.277728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 587/1160] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:03:05 2022] GET /identity/v3/projects/92b5267b6ff54c2dae82242ce416af00 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:05.283685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:05.347279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:05.380563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a57106-6831-4b02-ae01-f9c67e310231 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:05.413361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:05.413946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:05.414229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:05.414531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:05.415351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=92b5267b6ff54c2dae82242ce416af00, user.id=ceb1c54bca4f461db625099a85533d11) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:05.415661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:05.417078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fccae-a251-4fef-b0c4-a89360d77a0b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:05.422838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 574/1161] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:03:05 2022] GET /identity/v3/role_assignments?user.id=ceb1c54bca4f461db625099a85533d11&scope.project.id=92b5267b6ff54c2dae82242ce416af00&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:07.642893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf118c-a3a4-4419-9b40-262bf18c6a0b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:07.643540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf118c-a3a4-4419-9b40-262bf18c6a0b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:07.643540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf118c-a3a4-4419-9b40-262bf18c6a0b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:07.644827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 588/1162] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:07.650814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:07.651278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:07.651390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:07.667856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:07.669036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:07.734063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 575/1163] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:07.755969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf118c-a3a4-4419-9b40-262bf18c6a0b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:07.813907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:07.856204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf118c-a3a4-4419-9b40-262bf18c6a0b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:07.891477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:07.892131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:07.892417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:07.892694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:07.958042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:07.959604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:08.014469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:08.055711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 589/1164] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:03:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:03:08.061722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:08.120755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:08.158969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b632c-bbe7-438a-b56d-d365beb81a20 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:08.192964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:08.193757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:08.194044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:08.194323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:08.201029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:08.202525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8f868bab-8f2d-477c-983a-1b11c45f7bc3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:08.217088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:08.218478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:03:08.219622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 576/1165] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:03:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:08.224979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:08.321866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0e7-4c97-4531-9654-da6630636844 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:08.354966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:08.355623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:08.355909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:08.356193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:08.356911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:08.357221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:08.358674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17372fb-aa99-4400-a6b0-7796b7a59587 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:08.366267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 590/1166] 10.222.0.74 () {56 vars in 1115 bytes} [Fri May 27 15:03:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:10.531360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0be7-cb40-4c8e-95b3-b5c1ba4754e9 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:10.531915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0be7-cb40-4c8e-95b3-b5c1ba4754e9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:10.531915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0be7-cb40-4c8e-95b3-b5c1ba4754e9 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:10.533296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 577/1167] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:10.538488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b4de-e0ce-4dc8-854c-de50c8a35ad9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:10.538932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b4de-e0ce-4dc8-854c-de50c8a35ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:10.539035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b4de-e0ce-4dc8-854c-de50c8a35ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:10.555437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b638b4de-e0ce-4dc8-854c-de50c8a35ad9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:10.556608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b638b4de-e0ce-4dc8-854c-de50c8a35ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:10.572905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:10.620108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 591/1168] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:10.643160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a0be7-cb40-4c8e-95b3-b5c1ba4754e9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:10.742358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a0be7-cb40-4c8e-95b3-b5c1ba4754e9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:10.766196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:10.777821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:10.781658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:10.781658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:10.781658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:10.781658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:10.781658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4e23-c14f-4fc1-a0d9-10de5a287619 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:10.853112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 578/1169] 10.222.0.74 () {60 vars in 1138 bytes} [Fri May 27 15:03:10 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:03:13.065568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b9af2-044e-4dff-ad93-3cacc9c59d5b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:13.066110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b9af2-044e-4dff-ad93-3cacc9c59d5b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:13.066110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b9af2-044e-4dff-ad93-3cacc9c59d5b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:13.067680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 592/1170] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:13.073209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:13.073597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:13.073772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:13.091664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:13.092858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:13.158143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 579/1171] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:13.182097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b9af2-044e-4dff-ad93-3cacc9c59d5b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:13.280132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b9af2-044e-4dff-ad93-3cacc9c59d5b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:13.312594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:13.313441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:13.313722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:13.313998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] PATH_INFO: `/v3/domains/286d6e254d744d049a72ae72806b010b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:13.324684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=286d6e254d744d049a72ae72806b010b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:13.326130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f19ab2-6d1c-4589-bfe1-3a0fe68eeb85 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:13.327767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 593/1172] 10.222.0.74 () {56 vars in 1183 bytes} [Fri May 27 15:03:13 2022] GET /identity/v3/domains/286d6e254d744d049a72ae72806b010b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:13.333617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:13.428562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7bdc-9381-4104-aa75-5360b98aab83 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:13.440980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:13.460888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:13.464858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:13.464858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:13.464858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:13.464858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:13.464858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a299-7395-400d-b6b2-8e2d04523fa0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:13.571451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 580/1173] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:03:13 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:03:15.796055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283284-3b5b-4efa-a1fa-d5d15ae7f76b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:15.796603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283284-3b5b-4efa-a1fa-d5d15ae7f76b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:15.796603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283284-3b5b-4efa-a1fa-d5d15ae7f76b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:15.797986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 594/1174] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:15.803500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:15.803873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:15.804054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:15.820885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:15.822060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:15.886930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 581/1175] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:15.918016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283284-3b5b-4efa-a1fa-d5d15ae7f76b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:15.933739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:16.017302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283284-3b5b-4efa-a1fa-d5d15ae7f76b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:16.049891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:16.050699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:16.050985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:16.051259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] PATH_INFO: `/v3/domains/286d6e254d744d049a72ae72806b010b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:16.053319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=286d6e254d744d049a72ae72806b010b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:16.054773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aadf63-8389-4ce4-8a67-474edd2a5376 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:16.056372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 595/1176] 10.222.0.74 () {56 vars in 1183 bytes} [Fri May 27 15:03:15 2022] GET /identity/v3/domains/286d6e254d744d049a72ae72806b010b => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:16.062091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:16.151611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:16.157777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702006d9-7e59-4f76-b5a2-6ad31e465071 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:16.190980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:16.191635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:16.191913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:16.192187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:16.193035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:16.194614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7c0d9-9b62-48db-ae73-e998798ca5de None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:16.276348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 582/1177] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:03:16 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:03:18.511698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8f64-e5f6-483c-aa05-48c9c1ad5272 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:18.512268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8f64-e5f6-483c-aa05-48c9c1ad5272 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:18.512268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8f64-e5f6-483c-aa05-48c9c1ad5272 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:18.513627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 596/1178] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:18.519159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:18.519595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:18.519727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:18.537566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:18.538792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:18.603924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 583/1179] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:18.626869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a8f64-e5f6-483c-aa05-48c9c1ad5272 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:18.708811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:18.727981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a8f64-e5f6-483c-aa05-48c9c1ad5272 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:18.760585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:18.761411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:18.761695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:18.762014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:18.772842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:03:18.780409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:18.781549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:03:18.782689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 597/1180] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:18.787727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:18.867167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:18.886667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae4a5-1691-4b2a-9ea2-0e889a07436a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:18.923124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:18.924012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:18.924480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:18.925146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:18.925890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:18.926195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:18.927656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:18.935858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 584/1181] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:03:18.941617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:19.040652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd615f-e578-417f-a652-e13df16eb405 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:19.072892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:19.073751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:19.074031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:19.074302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] PATH_INFO: `/v3/users/dbeac1cab4004d35abf528ac2eb7ffab` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:19.084904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:19.088069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] RBAC: Authorizing `identity:get_user(user_id=dbeac1cab4004d35abf528ac2eb7ffab)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:19.089498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:19.091147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 598/1182] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:03:18 2022] GET /identity/v3/users/dbeac1cab4004d35abf528ac2eb7ffab => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:19.096916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:19.201581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3952b-abce-401c-91bf-4b75c7835551 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:19.234944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:19.235595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:19.235877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:19.236150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:19.248155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:19.301449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:19.303806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:19.399683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 585/1183] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:03:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:03:19.405551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:19.502567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12667-703b-4b39-9bc2-5f1b9df05392 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:19.535148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:19.536001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:19.536282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:19.536559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] PATH_INFO: `/v3/projects/e7452f402eea4c92af550c60dcb7f79e` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:19.538933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] RBAC: Authorizing `identity:get_project(project_id=e7452f402eea4c92af550c60dcb7f79e)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:19.540353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f0dab-8524-4259-a3fb-44c5a517a55b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:19.542032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 599/1184] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:03:19 2022] GET /identity/v3/projects/e7452f402eea4c92af550c60dcb7f79e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:19.548102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:19.589422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:19.645133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24275ac-2cef-46f5-a2d7-6525715608c5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:19.679038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:19.679688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:19.679974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:19.680251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:19.681072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=e7452f402eea4c92af550c60dcb7f79e, user.id=dbeac1cab4004d35abf528ac2eb7ffab) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:19.681385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:19.682846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacf0f-072d-4f04-9c86-655dc7d71276 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:19.688122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 586/1185] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:03:19 2022] GET /identity/v3/role_assignments?user.id=dbeac1cab4004d35abf528ac2eb7ffab&scope.project.id=e7452f402eea4c92af550c60dcb7f79e&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:03:21.823629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbbe3-cc09-48dc-a926-c421184d3638 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:21.824158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbbe3-cc09-48dc-a926-c421184d3638 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:21.824158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbbe3-cc09-48dc-a926-c421184d3638 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:21.825540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 600/1186] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:21.830883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:21.831262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:21.831447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:21.848123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:21.849833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:21.915733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 587/1187] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:21.938971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cbbe3-cc09-48dc-a926-c421184d3638 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:22.008861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:22.048701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cbbe3-cc09-48dc-a926-c421184d3638 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:22.082821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:22.083538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:22.083912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:22.084209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:22.094036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:03:22.101759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:22.102902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:03:22.103800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 601/1188] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:22.109292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:22.143491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:22.206570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87124ad-9c2a-4508-a012-0cc828f69a86 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:22.240973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742e088-0833-40be-987f-8532b0846489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:22.241660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742e088-0833-40be-987f-8532b0846489 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:22.241943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742e088-0833-40be-987f-8532b0846489 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:22.242219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742e088-0833-40be-987f-8532b0846489 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:22.242983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742e088-0833-40be-987f-8532b0846489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:22.243288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742e088-0833-40be-987f-8532b0846489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:22.244649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742e088-0833-40be-987f-8532b0846489 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:22.252436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 588/1189] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:22.258436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:22.356466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f62e2e-f93b-4c4e-87b5-0567b34f810b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:22.383347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:22.391649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:22.392771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:22.393051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:22.393325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] PATH_INFO: `/v3/users/dbeac1cab4004d35abf528ac2eb7ffab` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:22.394524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] RBAC: Authorizing `identity:get_user(user_id=dbeac1cab4004d35abf528ac2eb7ffab)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:22.395953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:22.398739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 602/1190] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:03:22 2022] GET /identity/v3/users/dbeac1cab4004d35abf528ac2eb7ffab => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:22.405421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742e088-0833-40be-987f-8532b0846489 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:22.502941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:22.507218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742e088-0833-40be-987f-8532b0846489 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:22.548235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:22.549083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:22.549363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:22.549632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] PATH_INFO: `/v3/projects/e7452f402eea4c92af550c60dcb7f79e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:22.550812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7452f402eea4c92af550c60dcb7f79e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:22.552238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04283c-c34c-4df7-93b3-fba5cf1c31b7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:22.553997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 589/1191] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:03:22 2022] GET /identity/v3/projects/e7452f402eea4c92af550c60dcb7f79e => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:22.559961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:22.664787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e3bb-bee9-4184-b47f-c55f131a34c0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:22.697790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:22.698797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:22.699084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:22.699370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] PATH_INFO: `/v3/projects/e7452f402eea4c92af550c60dcb7f79e/users/dbeac1cab4004d35abf528ac2eb7ffab/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:22.701298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7452f402eea4c92af550c60dcb7f79e, user_id=dbeac1cab4004d35abf528ac2eb7ffab, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:22.702746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98fa3-1676-44a1-9b01-d8ecee341781 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:22.793336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 603/1192] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:03:22 2022] PUT /identity/v3/projects/e7452f402eea4c92af550c60dcb7f79e/users/dbeac1cab4004d35abf528ac2eb7ffab/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:03:25.130435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1176e3-f079-46d6-8cbe-08a061b61904 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.131264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1176e3-f079-46d6-8cbe-08a061b61904 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.131553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1176e3-f079-46d6-8cbe-08a061b61904 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.132957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 590/1193] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:03:25.138663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.139114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.139223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.158629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:03:25.159755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:03:25.215745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:25.234629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 604/1194] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:03:25.261137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1176e3-f079-46d6-8cbe-08a061b61904 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:25.376711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1176e3-f079-46d6-8cbe-08a061b61904 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:25.417354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:25.418061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.418345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.418686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.429168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:03:25.437383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:03:25.438529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:03:25.439939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 591/1195] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:03:25.446027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:25.565878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9538-6463-4b9b-ae6f-4a0967ef7ba6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:25.603689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:25.604355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.604637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.604980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.606142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:25.606142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:25.608151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:25.618021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 605/1196] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:25.624170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:25.658655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:25.736881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3562e-2181-4164-b375-7aa059c2115d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:25.775905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:25.776898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.777184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.777464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] PATH_INFO: `/v3/users/dbeac1cab4004d35abf528ac2eb7ffab` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.778686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=dbeac1cab4004d35abf528ac2eb7ffab)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:25.780113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:25.781848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 592/1197] 10.222.0.74 () {56 vars in 1177 bytes} [Fri May 27 15:03:25 2022] GET /identity/v3/users/dbeac1cab4004d35abf528ac2eb7ffab => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:25.787861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:25.835386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:25.891209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796bc9-db2d-415d-ab7d-cc10374fc1bd None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:25.924578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:25.925230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:25.925518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:25.925795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:25.992941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:25.994305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:26.038095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:26.096662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 606/1198] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:03:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:03:26.102877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:26.198105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:26.204796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1a44-af75-44cc-b540-915c48ccf6e5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:26.238378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:26.239259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:26.239539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:26.239812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] PATH_INFO: `/v3/projects/e7452f402eea4c92af550c60dcb7f79e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:26.241924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] RBAC: Authorizing `identity:get_project(project_id=e7452f402eea4c92af550c60dcb7f79e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:26.243443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb160f24-73cd-4d97-b40d-bbe6f11e8b91 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:26.245087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 593/1199] 10.222.0.74 () {56 vars in 1186 bytes} [Fri May 27 15:03:26 2022] GET /identity/v3/projects/e7452f402eea4c92af550c60dcb7f79e => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:26.251379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:03:26.357610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f4ff-a578-4109-b99a-5a45446eb477 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:03:26.390331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:03:26.391006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:03:26.391290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:03:26.391567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:03:26.392643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=e7452f402eea4c92af550c60dcb7f79e, user.id=dbeac1cab4004d35abf528ac2eb7ffab) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:03:26.392948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:03:26.394366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7fe4-a160-468f-b419-035cbeee2cd7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:03:26.400017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 607/1200] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:03:26 2022] GET /identity/v3/role_assignments?user.id=dbeac1cab4004d35abf528ac2eb7ffab&scope.project.id=e7452f402eea4c92af550c60dcb7f79e&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:03:36.234339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=19 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:36.397433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:49.435099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703a72-81e5-403e-bb4b-aac028798692 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:49.435691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703a72-81e5-403e-bb4b-aac028798692 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:49.435691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703a72-81e5-403e-bb4b-aac028798692 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:49.437016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 594/1201] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:04:49.442462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:49.442866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:49.443018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:49.459795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:04:49.460927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:04:49.527188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 608/1202] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:04:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:04:49.552626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703a72-81e5-403e-bb4b-aac028798692 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:49.653132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703a72-81e5-403e-bb4b-aac028798692 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:49.687661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:49.688377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:49.688663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:49.688938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:49.698970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:49.700455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:04:49.718634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:49.719797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:49.721006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:04:49.721006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:04:49.721006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:49.721006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:04:49.721006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 595/1203] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:49.726640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:49.822369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c321c2-8cb7-4b6a-b162-d0cffb92b4ea None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:49.851976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:49.857656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:49.858318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:49.858635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:49.858914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:49.859632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:49.859943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:49.861336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7472e-e279-42e9-94d6-63c3a062deea None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:49.872403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 609/1204] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:49.878144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:49.934714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:49.980752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301192-05ad-47f3-a46d-ad945a89a9d0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:50.013134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:50.013800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:50.014086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:50.014368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:50.015102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:50.016537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41efe-568a-4905-968f-6de66bec3f8d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:50.134967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 596/1205] 10.222.0.74 () {60 vars in 1132 bytes} [Fri May 27 15:04:49 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:04:52.406326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70df47-bb4b-42d6-99c4-7bee51df3960 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:52.406929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70df47-bb4b-42d6-99c4-7bee51df3960 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:52.406929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70df47-bb4b-42d6-99c4-7bee51df3960 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:52.408270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 610/1206] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:04:52.414079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:52.414496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:52.414680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:52.431855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:04:52.433051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:04:52.498572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 597/1207] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:04:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:04:52.522503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70df47-bb4b-42d6-99c4-7bee51df3960 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:52.624971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70df47-bb4b-42d6-99c4-7bee51df3960 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:52.660173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:52.660909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:52.661197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:52.661478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:52.671608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:04:52.679501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:52.680600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:52.681482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 611/1208] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:52.686870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:52.726506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:52.783593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce63c67-c0db-443a-bb62-155fdb9eec97 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:52.815893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:52.816552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:52.816836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:52.817114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:52.817854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:52.818158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:52.820430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:52.828164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 598/1209] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:52.834081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:52.885375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:52.935905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb995c7-9377-46ce-9bd3-94cfd6b9fe7a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:52.969159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:52.969946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:52.970231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:52.970539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:52.982614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:52.985151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:04:53.001136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:53.002227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:53.003481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:04:53.003481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:04:53.003481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:53.003481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:53.003481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 612/1210] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:53.009044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:53.105643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:53.108537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a24ab-d2bb-4d70-af6d-7aeb7d258c2a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:53.141122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:53.141776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:53.142056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:53.142329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:53.143067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:53.143613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:53.145005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.156451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 599/1211] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:04:53.162359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:53.262123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404ebe0-6db4-4643-9896-21b182fc4207 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:53.263635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:53.296140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:53.296940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:53.297254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:53.297534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:53.304529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:53.305967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:04:53.321169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:53.322259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:53.323390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 613/1212] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:53.328243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:53.427015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb982a-4882-473b-b2ee-f97b145d658a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:53.461042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:53.461710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:53.461995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:53.462275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:53.463134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:53.463445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:53.464881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.481799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 600/1213] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:53.487775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:53.586615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250e8c-faa9-45fc-a30b-374f38435912 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:53.620696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:53.621356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:53.621641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:53.621918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:53.652733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:53.691851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:53.693385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.791926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 614/1214] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:04:53.797810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:53.816734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:53.895699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b138-65ed-496a-bfb0-abf9b2b846e9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:53.932879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:53.933674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:53.933958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:53.934232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:53.944053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:53.945645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:04:53.962988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:53.964056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:53.965329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:04:53.965329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:04:53.965329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:53.965329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:04:53.965329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 601/1215] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:53.969904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:54.030450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:54.070799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31af35-1de3-4414-b38f-2856291c17f3 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:54.110733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:54.111552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:54.111922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:54.112219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:54.113086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:54.113473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:54.115214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:54.130697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 615/1216] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:54.136638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:54.206055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:54.237437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e0446-4d80-4c7c-a469-cb40ef1b50cc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:54.271116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:54.272974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:54.273269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:54.273549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:54.279957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:54.281395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:04:54.297002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:54.298089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:04:54.303828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 602/1217] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:54.304809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:54.416492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6455a41-0695-4c3a-a3c2-d02750e7fd23 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:54.438492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:54.449560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:54.450215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:54.450524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:54.450802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:54.451572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:54.451876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:54.453302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c740de-096d-4c74-88b2-f72e78462e97 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:54.469198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 616/1218] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:04:54.471360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:54.580498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc1cf-3529-4141-8dd3-c5ee16acba52 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:54.608911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:54.614602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:54.615254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:54.615569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:54.615848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:54.616685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ea4efcee73dd41089b084d21f5cd5005) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:54.616998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:54.618447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe7b4a-eb01-4d9c-817b-73caf1bddb79 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:54.623880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 603/1219] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:04:54 2022] GET /identity/v3/role_assignments?user.id=ea4efcee73dd41089b084d21f5cd5005&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:56.798252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f00f-6898-4ebd-90bd-872f872ebeee None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:56.798926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f00f-6898-4ebd-90bd-872f872ebeee None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:56.798926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f00f-6898-4ebd-90bd-872f872ebeee None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:56.800220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 617/1220] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:04:56.806255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:56.806683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:56.806867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:56.824604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:04:56.827096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:04:56.891389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 604/1221] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:04:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:04:56.914685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78f00f-6898-4ebd-90bd-872f872ebeee None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.015455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78f00f-6898-4ebd-90bd-872f872ebeee None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.048247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.049101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.049328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.049596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.060449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:04:57.068310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:57.069798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:57.071015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 618/1222] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:57.075714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.173839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16149-f66b-48a1-a1d4-3faeeae371d9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.197859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:57.208393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.209585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.209873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.210146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.210974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:57.211285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:57.212660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:57.220604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 605/1223] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:57.227234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.269383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:57.324675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d4168-0a62-41c6-97fd-ae2c71e889d2 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.359134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.359995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.360284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.360562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.371337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:57.372773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:04:57.389906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:57.400492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:57.401915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:04:57.401915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:04:57.401915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:57.401915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:57.401915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 619/1224] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:57.402382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.500302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805921cb-8ac3-4a9f-bfcb-2d9b74bfeb17 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.538707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.539372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.539660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.539939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.540657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:57.540966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:57.542357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:57.554161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 606/1225] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:04:57.559998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.654654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:57.661114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae425-afc9-4a89-993d-59c69a014d17 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.694465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.695264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.695551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.695828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.702787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:57.704225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:04:57.720118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:57.726624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:57.727605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 620/1226] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:57.728214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.779393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:57.831406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0745-d4aa-4f58-a1e8-d6e526d93e2f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:57.864855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:57.865629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:57.865911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:57.866181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:57.867034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:57.867388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:57.868854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:57.885721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 607/1227] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:57.891437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:57.990839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb139-8e87-4c2a-801d-011fe056734a None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:58.024751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:58.025543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:58.025830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:58.026122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:58.036016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:58.037506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:04:58.055625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:58.056688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:58.058077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:04:58.058077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:04:58.058077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:04:58.058077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:58.058077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 621/1228] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:04:58.062536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:58.162017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ef78-f632-4252-9f46-137191861c6e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:58.164438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:58.195395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:58.196041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:58.196324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:58.196600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:58.197323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:58.197614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:58.199011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:58.210107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 608/1229] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:58.215901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:58.224883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:58.314180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9364-e279-462f-ac5b-a0980335f0a5 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:58.347314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:58.348138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:58.348423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:58.348707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:58.355746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:58.357185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:04:58.372426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:04:58.376262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:04:58.377388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 622/1230] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:04:58.379463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:58.477796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded162e-81e2-408e-994f-b0acf25249b9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:58.511816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:58.512512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:58.512799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:58.513078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:58.513853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:04:58.514825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:58.515673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130ded7-3b46-4fad-8222-8e014e8087e6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:58.529063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 609/1231] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:04:58.535182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:04:58.603891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:58.638454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da706e-834b-4fd3-8719-ee136d22021f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:04:58.671552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:04:58.672438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:04:58.672727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:04:58.673007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ea4efcee73dd41089b084d21f5cd5005/roles/d99b13f52fa74ec681a82a400632e1db` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:04:58.686840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=ea4efcee73dd41089b084d21f5cd5005, role_id=d99b13f52fa74ec681a82a400632e1db)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:04:58.688326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7863a7e-fcd5-49b2-88d9-6e87246c3f02 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:04:58.847162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 623/1232] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:04:58 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ea4efcee73dd41089b084d21f5cd5005/roles/d99b13f52fa74ec681a82a400632e1db => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:05:01.078919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08acb3-f709-4360-846f-20a28eca361a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.079498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08acb3-f709-4360-846f-20a28eca361a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.079498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08acb3-f709-4360-846f-20a28eca361a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.080845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 610/1233] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:01.086589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.087036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.087162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.104306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:01.105506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:01.170866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 624/1234] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:01.194428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08acb3-f709-4360-846f-20a28eca361a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:01.220041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:01.296653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08acb3-f709-4360-846f-20a28eca361a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:01.329592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:01.330373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.330685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.330956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.341302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:05:01.348895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:01.350229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:01.357564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 611/1235] 10.222.0.74 () {56 vars in 1102 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:01.358540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:01.402208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:01.452206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78620f30-a614-4159-9ccb-8571944cabbd None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:01.485963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:01.486670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.486961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.487242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.487990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] RBAC: Adding query filter params (name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:01.488304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:01.489676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:01.497754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 625/1236] 10.222.0.74 () {56 vars in 1103 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:01.503442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:01.588003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:01.603165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7477-e8d0-40d4-8270-9d06289ba07a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:01.635486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:01.636268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.636571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.636872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.648196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:01.649483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:01.666882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:01.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:01.669264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:01.669264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:01.669264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:01.669264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:01.669264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 612/1237] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:01.673817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:01.775806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a7e3-2530-47ec-aecd-e285fe30e507 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:01.784527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:01.808817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:01.809476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.809760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.810044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.810788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:01.811095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:01.812446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:01.824379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 626/1238] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:01.830038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:01.930528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada4409-0fb2-4b3c-8a94-80cf1f6905c9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:01.963476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:01.964274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:01.964553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:01.964829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:01.967509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:01.972574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:01.974001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:05:01.988162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:01.994560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:01.995589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 613/1239] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:01.996227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:02.098868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11974b0-bf88-4366-a42b-6f8df0f4cbb7 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:02.133309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:02.133971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:02.134257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:02.134566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:02.135389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:02.135698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:02.137131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:02.154539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 627/1240] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:05:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:02.160301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:02.257982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979f02-8cfc-42f9-a58b-4ad7b5b584c8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:02.290964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:02.297724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:02.297724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:02.297724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:02.352130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:02.358568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:02.362663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:02.455063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 614/1241] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:05:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:05:02.461585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:02.488349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:02.559199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd81a1-2e64-43b4-92c1-864139bace03 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:02.592259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:02.593045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:02.593986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:02.593986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:02.603565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:02.604927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:02.623179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:02.629274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:02.630181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:02.630181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:02.630181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:02.630181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:02.630181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 628/1242] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:02.631332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:02.723831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:02.729540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad494f-894b-4240-bc3f-691649acd40f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:02.763925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:02.764590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:02.764870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:02.765140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:02.765855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:02.766157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:02.767660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:02.779472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 615/1243] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:05:02.785230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:02.863571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:02.884711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c17b-62f1-4b6f-b516-92907a663c75 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:02.919008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:02.920892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:02.920892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:02.920892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:02.926849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:02.928830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:05:02.942159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:02.943300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:02.944411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 629/1244] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:02.949475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:03.046063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8755-5184-4484-a585-b944b616b84e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:03.079356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:03.080011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:03.080295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:03.080567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:03.081346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:03.081653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:03.083111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef76b51-9af6-402b-a269-cb593613d95c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:03.094806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 616/1245] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:03.101622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:03.202751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cfd52-cca2-46ec-9307-49f23ce0ab08 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:03.236521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:03.237241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:03.237530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:03.237808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:03.238654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] RBAC: Adding query filter params (role.id=d99b13f52fa74ec681a82a400632e1db, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ea4efcee73dd41089b084d21f5cd5005) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:03.238966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:03.240625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59571b97-7eb8-4d71-a437-37765e60dd68 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:03.246304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 630/1246] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:05:03 2022] GET /identity/v3/role_assignments?user.id=ea4efcee73dd41089b084d21f5cd5005&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=d99b13f52fa74ec681a82a400632e1db => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:05.486477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037708f2-75ca-4661-a665-3af978a6546d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:05.487044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037708f2-75ca-4661-a665-3af978a6546d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:05.487044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037708f2-75ca-4661-a665-3af978a6546d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:05.488411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 617/1247] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:05.494482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:05.494865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:05.495044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:05.500110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:05.512601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:05.513877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:05.579711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 631/1248] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:05.603662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037708f2-75ca-4661-a665-3af978a6546d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:05.622380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:05.706177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037708f2-75ca-4661-a665-3af978a6546d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:05.739214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:05.740743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:05.741425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:05.741707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:05.752327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:05:05.760700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:05.761800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:05.762710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 618/1249] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:05.768108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:05.864333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cef4eb-6772-4274-85da-372609c65cd8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:05.893586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:05.898757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:05.899434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:05.899722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:05.900001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:05.900747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:05.901059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:05.902448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:05.910936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 632/1250] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:05.917227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:05.998321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:06.020322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af1f0-62f3-47e4-b4aa-4ecc9e9dafc5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.053314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:06.056448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:06.056448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:06.056448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:06.064596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:06.066037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:06.082461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:06.087201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:06.088361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:06.088361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:06.088361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:06.088361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:06.088361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 619/1251] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:06.090070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:06.191035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7076b4-db20-4cc1-beaf-077f1da8f95c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.226739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:06.227398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:06.227679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:06.227955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:06.228669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:06.228976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:06.230324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:06.242575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 633/1252] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:06.248233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:06.345907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44be8e-3141-4a4a-bdf2-3b810b6908cc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.371380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:06.378878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:06.379664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:06.379944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:06.380752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:06.387895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:06.389386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:05:06.403348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:06.404563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:06.405562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 620/1253] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:06.410259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:06.464744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:06.508231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7d90-1f3a-43ff-b8e6-0cab06318930 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.541283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:06.541976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:06.542264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:06.542684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:06.543509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:06.543820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:06.545247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:06.562333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 634/1254] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:05:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:06.568819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:06.669139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393d3c-783f-424e-bc80-f20d4728ca19 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.702343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:06.703015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:06.703296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:06.703568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:06.759708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:06.771733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:06.773325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:06.869355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 621/1255] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:05:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:05:06.875160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:06.980388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd9afe-9745-425d-b377-43b2afe8c110 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:06.993194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:07.013378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:07.015408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:07.015408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:07.015408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:07.025533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:07.027007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:07.044801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:07.045904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:07.047143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:07.047143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:07.047143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:07.047143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:07.047143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 635/1256] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:07.053586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:07.138536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:07.151501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691874f-70f5-4590-b3ea-f56d950f1863 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:07.185071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:07.185724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:07.186004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:07.186276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:07.187014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:07.187316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:07.188674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:07.199837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 622/1257] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:05:07.205433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:07.306874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687eea-7ff5-4c8a-b187-179dc5d53094 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:07.341065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:07.341844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:07.342130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:07.342432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:07.349330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:07.350808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:05:07.364352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:07.366562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:07.367791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 636/1258] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:07.371779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:07.471717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc659e-97bb-455b-bf64-2132d0fc4521 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:07.504181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:07.506798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:07.506798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:07.506798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:07.507157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:07.507469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:07.508903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04420-48a2-404c-b815-7ac2f3fd2258 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:07.521864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 623/1259] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:07.527951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:07.553015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:07.624264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06efe-b87f-4fa3-a467-e512ccd0685d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:07.658451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:07.659123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:07.659424 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:07.659780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:07.660605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ea4efcee73dd41089b084d21f5cd5005) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:07.660920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:07.662962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71119da-ec1e-4cee-b113-1d90049bc2f2 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:07.668481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 637/1260] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:05:07 2022] GET /identity/v3/role_assignments?user.id=ea4efcee73dd41089b084d21f5cd5005&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:09.859127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce15652-a0ab-4f93-8ccf-b9a1a2e83a4b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:09.859681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce15652-a0ab-4f93-8ccf-b9a1a2e83a4b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:09.859681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce15652-a0ab-4f93-8ccf-b9a1a2e83a4b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:09.861066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 624/1261] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:09.867077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:09.873324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:09.873324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:09.884139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:09.885368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:09.952028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 638/1262] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:09.976198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce15652-a0ab-4f93-8ccf-b9a1a2e83a4b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:09.987126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.077284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce15652-a0ab-4f93-8ccf-b9a1a2e83a4b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.112053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.112778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.113062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.113341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.123771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:05:10.131453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:10.133445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:10.134653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 625/1263] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:10.138699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:10.157266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.236763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897b53-16cb-4374-95e8-45b462b33e3f None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.269855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.271076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.271352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.271653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.272374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:10.272684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:10.274059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:10.282170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 639/1264] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:10.288604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:10.356134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.388650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1720-a0cb-43d2-a37a-82c1700c1975 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.423042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.423832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.424120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.424400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.435096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:10.438458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:10.453777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:10.454868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:10.456082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:10.456082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:10.456082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:10.456082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:10.456082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 626/1265] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:10.461591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:10.542823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.561359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fed1-5d06-4129-b7b3-f84207c71a4f None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.594643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.595318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.595598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.595878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.596668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:10.596981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:10.598339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:10.609353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 640/1266] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:10.618355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:10.715292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e8652-67f5-418b-b0df-84c2c4e79424 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.734478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.749286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.750086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.750398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.750712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.759109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:10.760549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:05:10.775181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:10.776342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:10.777628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 627/1267] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 15:05:10.782590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:10.880939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580d37-5270-40ec-87f1-cf4afaba3d4e None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:10.917511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:10.918183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:10.918493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:10.918769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:10.919596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:10.919906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:10.921328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:10.931191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:10.939511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 641/1268] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:10.945979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:11.046150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254d40-24c4-406f-a1bc-ca3a99cf5a85 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:11.080054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:11.080833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:11.081113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:11.081383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:11.092020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:11.093455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:11.110471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:11.111548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:11.116484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:11.116484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:11.116484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:11.116484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:11.116484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 628/1269] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:11.118521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:11.222969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c363d8-fcc1-4c99-bc40-c31938af293c None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:11.257204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:11.257862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:11.258148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:11.258450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:11.259227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:11.259575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:11.260942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:11.272236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 642/1270] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:11.277884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:11.310829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:11.378297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c5eb-3cd1-47f1-ba40-3df3faadfe8f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:11.413076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:11.423071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:11.423071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:11.423071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:11.423071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:11.423071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:05:11.436895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:11.437930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:11.439017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 629/1271] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:11.444157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:11.504163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:11.547786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0f33-80bc-4efc-b19c-f5bc720df01b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:11.581697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:11.582286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:11.582610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:11.583428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:11.584679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:11.584995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:11.586455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14db168-6c09-406f-bed1-8321b064b46a None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:11.598303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 643/1272] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:11.605623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:11.694957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:11.703138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9913f56-53fe-4b5f-bbfe-b10c8fbf3e83 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:11.738782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:11.739696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:11.739971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:11.740249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] PATH_INFO: `/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ea4efcee73dd41089b084d21f5cd5005/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:11.742172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] RBAC: Authorizing `identity:create_grant(project_id=63aab9b7eef342e58c0d85fa393184f7, user_id=ea4efcee73dd41089b084d21f5cd5005, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:11.743632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1cd1c-ed00-4c25-a35e-6aaef8305376 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:11.912762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 630/1273] 10.222.0.74 () {58 vars in 1439 bytes} [Fri May 27 15:05:11 2022] PUT /identity/v3/projects/63aab9b7eef342e58c0d85fa393184f7/users/ea4efcee73dd41089b084d21f5cd5005/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:05:14.090889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4962-5924-4bb8-a522-96afec93dd70 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.091442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4962-5924-4bb8-a522-96afec93dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.091442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4962-5924-4bb8-a522-96afec93dd70 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.092828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 644/1274] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:14.097868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.099100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.099100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.116007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:14.117178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:14.183387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 631/1275] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:14.223056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4962-5924-4bb8-a522-96afec93dd70 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:14.326104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4962-5924-4bb8-a522-96afec93dd70 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:14.343836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:14.360285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:14.361068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.361352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.361627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.372333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 15:05:14.380033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:14.381122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:14.382036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 645/1276] 10.222.0.74 () {56 vars in 1096 bytes} [Fri May 27 15:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:14.387342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:14.478975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:14.495615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b04cf8-39ae-47dc-8c9c-ac04c9377347 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:14.528556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:14.529218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.529499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.529773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.530537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:14.530844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:14.532219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:14.542917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 632/1277] 10.222.0.74 () {56 vars in 1099 bytes} [Fri May 27 15:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:14.546451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:14.646761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e3d4-5cea-4e20-a089-7eab8b026c6b None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:14.679413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:14.680198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.680485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.680766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.691128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:14.692620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:14.709934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:14.711067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:14.712011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:14.712011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:14.712011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:14.712011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:14.712011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 646/1278] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:14.717188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:14.818944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83dbf-0b54-40e3-9ac4-855bec354852 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:14.851933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:14.852588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:14.852869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:14.853143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:14.853847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:14.854152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:14.855561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:14.867063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 633/1279] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:14.872670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:14.907524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:14.975116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad1fd-a4d3-4e36-9869-ebe66b03b52d None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.009117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.009921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.010211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.010516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.018399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.019994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 15:05:15.037586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:15.038890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:15.040281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 647/1280] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:15.044875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:15.048778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:15.143444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d78dc-5fcc-43a3-beb5-32bfc17c1203 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.177167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.178106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.178106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.178459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.179285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:15.179617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.181040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.199184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 634/1281] 10.222.0.74 () {56 vars in 1143 bytes} [Fri May 27 15:05:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:15.204928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:15.295682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:15.305540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a4b9-796a-4e9d-b8c0-d13343a157cf None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.338379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.339059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.339344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.339622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.404983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.406372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.493489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:15.503358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 648/1282] 10.222.0.74 () {58 vars in 1282 bytes} [Fri May 27 15:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 15:05:15.509999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:15.572462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:15.610607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9efabf-4bdd-411a-998a-a488c02436ae None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.643657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.644443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.644725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.645022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.654646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.656133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 15:05:15.673459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:15.674594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:15.675806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 15:05:15.675806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 15:05:15.675806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 15:05:15.675806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:15.675806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 635/1283] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:15.680998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:15.777892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379d93-b64a-4eeb-b5b1-5310415f9535 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.813629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.816264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.816264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.816264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.816264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:15.816264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.817425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.828554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 649/1284] 10.222.0.74 () {56 vars in 1109 bytes} [Fri May 27 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:15.834751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:15.936019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff6ff-5e3b-4904-b297-7002e020ae5d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:15.949651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:15.969598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:15.974382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:15.974382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:15.974382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:15.978226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:15.979683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 15:05:15.993538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:15.994646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application May 27 15:05:15.995773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 636/1285] 10.222.0.74 () {56 vars in 1111 bytes} [Fri May 27 15:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:16.002606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:16.053551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:16.102108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a18d-35b9-46e2-8f4e-b7fdc434c9da None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:16.134901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:16.135559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:16.135846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:16.136174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:16.136946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:16.137256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:16.138706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8dba-d696-4627-9456-e42a34575321 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:16.151565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 650/1286] 10.222.0.74 () {56 vars in 1148 bytes} [Fri May 27 15:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:16.157735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:16.257541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe63e-6489-4f5c-9ddf-7bfddfa0461d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:16.291679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:16.292332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:16.292615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:16.292926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:16.293747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] RBAC: Adding query filter params (role.id=b95ee83688ee4a2f9c8598baac92e53a, scope.project.id=63aab9b7eef342e58c0d85fa393184f7, user.id=ea4efcee73dd41089b084d21f5cd5005) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:16.294057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:16.295590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374e9a4-884b-41eb-92e2-74729def726f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:16.301364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 637/1287] 10.222.0.74 () {56 vars in 1374 bytes} [Fri May 27 15:05:16 2022] GET /identity/v3/role_assignments?user.id=ea4efcee73dd41089b084d21f5cd5005&scope.project.id=63aab9b7eef342e58c0d85fa393184f7&role.id=b95ee83688ee4a2f9c8598baac92e53a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:18.519442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619844a-d883-41b5-a62f-abb26bcee9a2 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:18.520070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619844a-d883-41b5-a62f-abb26bcee9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:18.520070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619844a-d883-41b5-a62f-abb26bcee9a2 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:18.521416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 651/1288] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:18.526861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:18.527255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:18.527471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:18.544517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:18.545705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:18.576389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:18.613241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 638/1289] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:18.636423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619844a-d883-41b5-a62f-abb26bcee9a2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:18.738229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619844a-d883-41b5-a62f-abb26bcee9a2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:18.749783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:18.773214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:18.773953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:18.774242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:18.774561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:18.775214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:18.776590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:18.788915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:18.790188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:18.791105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 652/1290] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:05:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:18.796599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:18.899276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2146-56f9-44ee-903a-b880bfb3f206 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:18.939883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:18.940552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:18.940833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:18.941107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:18.942311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:18.942764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:18.944021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5d5e-0f0a-478f-b3e8-7db49748a8a8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:18.948814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 639/1291] 10.222.0.74 () {56 vars in 1116 bytes} [Fri May 27 15:05:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:05:18.954719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:19.056715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dacc2-d4eb-49cc-8fc5-bb665f41b294 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:19.090335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:19.091030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:19.091316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:19.091596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] PATH_INFO: `/v3/services` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:19.092300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:19.092609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:19.094062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87c12-4492-488a-b7c8-10015a3a4a17 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:19.098525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 653/1292] 10.222.0.74 () {56 vars in 1116 bytes} [Fri May 27 15:05:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:21.278343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6c5e-d51b-4c35-aa4f-768eb2a7eca8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:21.278908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6c5e-d51b-4c35-aa4f-768eb2a7eca8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:21.279007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6c5e-d51b-4c35-aa4f-768eb2a7eca8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:21.280343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 640/1293] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:21.285672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32611-102f-4ae3-a3ed-fc1a5b362a6a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:21.286113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32611-102f-4ae3-a3ed-fc1a5b362a6a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:21.286208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32611-102f-4ae3-a3ed-fc1a5b362a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:21.304160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-87d32611-102f-4ae3-a3ed-fc1a5b362a6a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:21.305359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-87d32611-102f-4ae3-a3ed-fc1a5b362a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:21.336858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:21.375021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 654/1294] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:21.399429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d6c5e-d51b-4c35-aa4f-768eb2a7eca8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:21.431257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:21.500194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d6c5e-d51b-4c35-aa4f-768eb2a7eca8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:21.533792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:21.534390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:21.534706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:21.534984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:21.536003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:21.537381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2212cf2-d0a7-4dea-82e2-bcce69556026 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:21.622971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 641/1295] 10.222.0.74 () {60 vars in 1141 bytes} [Fri May 27 15:05:21 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:05:23.827577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aca6c-8d0e-4979-a4eb-d10451199c31 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:23.828101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aca6c-8d0e-4979-a4eb-d10451199c31 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:23.828214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aca6c-8d0e-4979-a4eb-d10451199c31 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:23.829614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 655/1296] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:23.835057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:23.836524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:23.836524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:23.852782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:23.853969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:23.926992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 642/1297] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:23.949117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aca6c-8d0e-4979-a4eb-d10451199c31 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:24.053026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aca6c-8d0e-4979-a4eb-d10451199c31 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:24.086108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6203-737f-488f-936e-1918873da622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:24.086858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6203-737f-488f-936e-1918873da622 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:24.087139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6203-737f-488f-936e-1918873da622 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:24.087417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6203-737f-488f-936e-1918873da622 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:24.088058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb6203-737f-488f-936e-1918873da622 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:24.089432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb6203-737f-488f-936e-1918873da622 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-76cb6203-737f-488f-936e-1918873da622 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:24.101641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:24.102908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:24.103810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 656/1298] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:05:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:24.108929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:24.127718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:24.204713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d47b9-5dc6-47ee-85fa-3c27b64b5559 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:24.239712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:24.240371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:24.240651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:24.240922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:24.241655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:24.241958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:24.243349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:24.248461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 643/1299] 10.222.0.74 () {56 vars in 1116 bytes} [Fri May 27 15:05:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:24.254606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6203-737f-488f-936e-1918873da622 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:24.287259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:24.354543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6203-737f-488f-936e-1918873da622 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:24.387166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:24.387813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:24.388097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:24.388371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:24.389143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] RBAC: Adding query filter params (interface=public, service_id=2f96b32479a54d8abcdf315efd537e3b, region_id=RegionOne) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:24.389451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:24.390837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5176b96-6c7b-498f-94c9-352391fb7333 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:24.396510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 657/1300] 10.222.0.74 () {56 vars in 1251 bytes} [Fri May 27 15:05:24 2022] GET /identity/v3/endpoints?service_id=2f96b32479a54d8abcdf315efd537e3b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:24.402154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:24.482421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:24.499568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f16b-f5e5-48cc-8418-f6b2d46fb848 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:24.532702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:24.533360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:24.533643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:24.533921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:24.534634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:24.536789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ec00e-6dc5-4127-bde9-e71e132805ac None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:24.543428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 644/1301] 10.222.0.74 () {56 vars in 1087 bytes} [Fri May 27 15:05:24 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:05:26.760785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa688d-7567-4b9f-bb81-5948926ad77b None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:26.761374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa688d-7567-4b9f-bb81-5948926ad77b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:26.761374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa688d-7567-4b9f-bb81-5948926ad77b None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:26.762780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 658/1302] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:05:26.768131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:26.768525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:26.768685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:26.786127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:05:26.787364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:05:26.854187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 645/1303] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:05:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 15:05:26.877544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa688d-7567-4b9f-bb81-5948926ad77b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:26.971127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:26.978962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa688d-7567-4b9f-bb81-5948926ad77b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:27.014089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:27.015245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:27.015897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:27.016170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:27.016808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:27.019223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 15:05:27.031027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 15:05:27.032252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.get_or_create( May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application with Lock( May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self._enter() May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application return self.creator() May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application created_value = creator( May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: ERROR keystone.server.flask.application May 27 15:05:27.033116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 659/1304] 10.222.0.74 () {56 vars in 1117 bytes} [Fri May 27 15:05:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 15:05:27.039666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:27.115099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:27.137521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fd24-b618-40f1-8bcc-8687bb964d7d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:27.171901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:27.172599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:27.172882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:27.173159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:27.173860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:05:27.174168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:27.175577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7027422-da0d-4ae4-88d0-b894661316e5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:27.181375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 646/1305] 10.222.0.74 () {56 vars in 1116 bytes} [Fri May 27 15:05:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:05:27.187082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:05:27.287069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7692-48d7-4518-964a-bd87edd4a9c0 None admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:05:27.321214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:05:27.321871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:05:27.322153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:05:27.322453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:05:27.323199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:05:27.324555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece34b-afe0-4c05-ac51-e981fa1d5841 None admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:05:27.414680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 660/1306] 10.222.0.74 () {60 vars in 1144 bytes} [Fri May 27 15:05:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:05:37.225524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=30 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:37.409089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:12.295476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814d64-7fbf-45f5-95b4-76def421bd12 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:12.295476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814d64-7fbf-45f5-95b4-76def421bd12 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:12.295476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814d64-7fbf-45f5-95b4-76def421bd12 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:12.297156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 647/1307] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:12.309991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56eb96-d0b7-4e0e-b388-80b13b687888 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:12.312058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56eb96-d0b7-4e0e-b388-80b13b687888 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:12.313490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56eb96-d0b7-4e0e-b388-80b13b687888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:12.488600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0a56eb96-d0b7-4e0e-b388-80b13b687888 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:12.491038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0a56eb96-d0b7-4e0e-b388-80b13b687888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:12.622439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 661/1308] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:12.673147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:12.673742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:12.674180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:12.676788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 648/1309] 10.222.0.74 () {54 vars in 964 bytes} [Fri May 27 15:12:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:12.683375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dc94-5a2e-461c-aa4f-fc702a6fdbe9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:12.683708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dc94-5a2e-461c-aa4f-fc702a6fdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:12.683844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dc94-5a2e-461c-aa4f-fc702a6fdbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:12.764770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-9dc2dc94-5a2e-461c-aa4f-fc702a6fdbe9 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:12.766229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9dc2dc94-5a2e-461c-aa4f-fc702a6fdbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:12.788012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:12.846454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 662/1310] 10.222.0.74 () {58 vars in 1061 bytes} [Fri May 27 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:12.855610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:12.857717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:12.976559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995ac5f-8f87-40c0-a0e0-5d6f0a02f20c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:13.055153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:13.055804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:13.056084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:13.056878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:13.060290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:13.115367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:13.174624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:13.176148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139ab3-d266-4d5e-b6c5-18e16a7923b2 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:13.196620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 649/1311] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:15.702241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:15.702833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:15.702833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:15.704385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 663/1312] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:15.709346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53149-881a-4e7f-87ce-9ab212d360f6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:15.709742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53149-881a-4e7f-87ce-9ab212d360f6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:15.709925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53149-881a-4e7f-87ce-9ab212d360f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:15.783744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-40a53149-881a-4e7f-87ce-9ab212d360f6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:15.784949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-40a53149-881a-4e7f-87ce-9ab212d360f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:15.887366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 650/1313] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:15.924649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:15.926358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:16.036499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fb80e-fa26-4568-acc5-747d14d1bdeb None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:16.115411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:16.118684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:16.120205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:16.120594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:16.120998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:16.122825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:16.240355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:16.241783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77859-2dac-4ed1-9419-cf06edddd18d service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:16.261287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 664/1314] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:19.000483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:19.001000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:19.001000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:19.002363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 651/1315] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:19.007719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cc3-2f8e-47fd-aca4-d44411c5b46b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:19.008115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cc3-2f8e-47fd-aca4-d44411c5b46b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:19.008278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cc3-2f8e-47fd-aca4-d44411c5b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:19.071354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-adef5cc3-2f8e-47fd-aca4-d44411c5b46b None None] MFA Rules not processed for user `f040341105664752ba9be38ec7dad1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:19.072712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-adef5cc3-2f8e-47fd-aca4-d44411c5b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:19.124575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:19.169137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 665/1316] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:19.207923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:19.209454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:19.219660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:19.314619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9a35-0a70-44c1-bb0b-40477df9a266 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:19.385973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:19.386642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:19.386923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:19.387195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:19.388834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:19.449270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:19.495097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:19.496555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828fa7f-2cde-4ff5-a638-7643a27ad449 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:19.514677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 652/1317] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:22.504153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f28a0-0701-453d-a30b-f0f03462f4c9 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:22.504722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f28a0-0701-453d-a30b-f0f03462f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:22.504722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f28a0-0701-453d-a30b-f0f03462f4c9 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:22.506097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 666/1318] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:22.512388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc790-385d-4f1e-b388-7277a87c9093 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:22.512785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc790-385d-4f1e-b388-7277a87c9093 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:22.512945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc790-385d-4f1e-b388-7277a87c9093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:22.579474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-60fbc790-385d-4f1e-b388-7277a87c9093 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:22.580685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-60fbc790-385d-4f1e-b388-7277a87c9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:22.679867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 653/1319] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:22.734974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:22.735261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:22.735539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:22.736935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 667/1320] 10.222.0.74 () {54 vars in 964 bytes} [Fri May 27 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:22.742721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134712d-bcc9-4952-bb05-5e4718f120d9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:22.743015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134712d-bcc9-4952-bb05-5e4718f120d9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:22.743296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134712d-bcc9-4952-bb05-5e4718f120d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:22.765191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:22.819743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3134712d-bcc9-4952-bb05-5e4718f120d9 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:22.820961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3134712d-bcc9-4952-bb05-5e4718f120d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:22.895373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 654/1321] 10.222.0.74 () {58 vars in 1061 bytes} [Fri May 27 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:22.904313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:22.905826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:23.008107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b78366-b5fa-403e-8a70-69d610588509 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:23.082803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:23.083367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:23.083676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:23.083954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:23.085600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:23.093432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:23.195625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:23.197149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17737f01-8d6b-40f0-a9c5-ce7d2d4ac2e3 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:23.214818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 668/1322] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:26.997086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:26.997609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:26.997736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:26.999067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 655/1323] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:27.004413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87c5f-907d-431e-bc83-b7c30879ad50 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:27.004853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87c5f-907d-431e-bc83-b7c30879ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:27.004950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87c5f-907d-431e-bc83-b7c30879ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:27.073793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f1e87c5f-907d-431e-bc83-b7c30879ad50 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:27.075030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f1e87c5f-907d-431e-bc83-b7c30879ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:27.135636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:27.174911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 669/1324] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:27.210175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:27.211752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:27.315839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577f0a0-db25-462b-a3e9-33807f8554af None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:27.328320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:27.390080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:27.390757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:27.391300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:27.391569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:27.393205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:27.504482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:27.505843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cfb2e-7a36-49e8-accd-9ec0f8a40642 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:27.524445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 656/1325] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:29.872829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:29.873366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:29.873366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:29.874837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 670/1326] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:29.880251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a43a0-95f1-4b39-b86f-c7fe5f5e2491 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:29.880637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a43a0-95f1-4b39-b86f-c7fe5f5e2491 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:29.880820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a43a0-95f1-4b39-b86f-c7fe5f5e2491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:29.929562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:29.947770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0e1a43a0-95f1-4b39-b86f-c7fe5f5e2491 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:29.948994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0e1a43a0-95f1-4b39-b86f-c7fe5f5e2491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:30.046745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 657/1327] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:30.082717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:30.084233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:30.190984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5c46-42c3-46be-bdfd-8cb4b0680365 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:30.266626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:30.267296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:30.267574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:30.267852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:30.269495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:30.286607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:30.380064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:30.381500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1ea97-617a-4750-afdb-8aaef9b51c3f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:30.401389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 671/1328] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:32.702648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:32.703188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:32.703188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:32.704764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 658/1329] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:32.709876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330538c-e17d-46ca-b38a-8b9cec252eae None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:32.710260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330538c-e17d-46ca-b38a-8b9cec252eae None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:32.710474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330538c-e17d-46ca-b38a-8b9cec252eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:32.777442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4330538c-e17d-46ca-b38a-8b9cec252eae None None] MFA Rules not processed for user `f040341105664752ba9be38ec7dad1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:32.778721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4330538c-e17d-46ca-b38a-8b9cec252eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:32.846124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:32.878667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 672/1330] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:32.916377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:32.917929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:33.022175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af1f7f-3888-46fb-8a70-986bc9142d6e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:33.042226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:33.095238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:33.095892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:33.096180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:33.096465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:33.098117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:33.206914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:33.208360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ecfd3-0456-4a9a-9f4b-5522d32c757e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:33.228908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 659/1331] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:36.024693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:36.026462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:36.026462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:36.027216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 673/1332] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:36.032505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a6d-5bdc-4400-88a4-5a062aa231c2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:36.032888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a6d-5bdc-4400-88a4-5a062aa231c2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:36.033059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58a6d-5bdc-4400-88a4-5a062aa231c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:36.096357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:36.098984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-59a58a6d-5bdc-4400-88a4-5a062aa231c2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:36.100168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-59a58a6d-5bdc-4400-88a4-5a062aa231c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:36.215863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 660/1333] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:36.251167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:36.252739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:36.368708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476abfd-9947-4deb-bfc4-015d2dfa7bfd None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:36.449264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:36.449914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:36.450194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:36.450503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:36.452132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:36.479658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:36.576671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:36.578116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0a1cc-58a4-4a94-9912-026fd899a7a5 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:36.597041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 674/1334] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:38.832039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:38.832583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:38.832583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:38.833966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 661/1335] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:38.839166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67261-ba3a-434c-acdc-94093cd84328 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:38.839577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67261-ba3a-434c-acdc-94093cd84328 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:38.839718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67261-ba3a-434c-acdc-94093cd84328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:38.905397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-21d67261-ba3a-434c-acdc-94093cd84328 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:38.906667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-21d67261-ba3a-434c-acdc-94093cd84328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:38.981886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:39.004508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 675/1336] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:39.044328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:39.045870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:39.149504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c781c5-9d32-4bcb-b1e9-67701df9e8e5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:39.178305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:39.224331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:39.224981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:39.225262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:39.225533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:39.227216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:39.335682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:39.337649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99566-d05b-41e9-8773-dc50f5ad6c06 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:39.356349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 662/1337] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:42.164856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:42.166012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:42.166012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:42.167437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 676/1338] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:42.172741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0cb85-7a9c-45e6-aca3-b4be908ec810 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:42.173165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0cb85-7a9c-45e6-aca3-b4be908ec810 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:42.173327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0cb85-7a9c-45e6-aca3-b4be908ec810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:42.237017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bcc0cb85-7a9c-45e6-aca3-b4be908ec810 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:42.238208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bcc0cb85-7a9c-45e6-aca3-b4be908ec810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:42.246498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:42.333416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 663/1339] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:42.369465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:42.372476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:42.481400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072826d-d8ec-4c5c-be53-6cae73f8443c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:42.539557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:42.540362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:42.540746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:42.541033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:42.542701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:42.598256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:42.647157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:42.648626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1f19-d1ab-47cf-bf19-93ae868de20f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:42.669000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 677/1340] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:47.263131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebef78-d971-4936-be11-804924d19133 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:47.263695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebef78-d971-4936-be11-804924d19133 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:47.263695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebef78-d971-4936-be11-804924d19133 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:47.265229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 664/1341] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:47.270764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96bc7c-c02b-4e38-9cc4-2e25c7e29b59 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:47.271239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96bc7c-c02b-4e38-9cc4-2e25c7e29b59 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:47.271323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96bc7c-c02b-4e38-9cc4-2e25c7e29b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:47.319819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bd96bc7c-c02b-4e38-9cc4-2e25c7e29b59 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:47.321031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bd96bc7c-c02b-4e38-9cc4-2e25c7e29b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:47.398710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 678/1342] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:47.438327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebef78-d971-4936-be11-804924d19133 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:47.440648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e2ebef78-d971-4936-be11-804924d19133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:47.464442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebef78-d971-4936-be11-804924d19133 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:47.467999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:47.468638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:47.468918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:47.469190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:47.479505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:47.481036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a266e-4530-4e97-a25c-3ebef474d478 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:47.490689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 665/1343] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:50.670741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:50.671272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:50.671382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:50.672817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 679/1344] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:50.677774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cab9f-bd75-4bee-9933-5bf230898fdf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:50.678180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cab9f-bd75-4bee-9933-5bf230898fdf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:50.678346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cab9f-bd75-4bee-9933-5bf230898fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:50.708388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-907cab9f-bd75-4bee-9933-5bf230898fdf None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:50.709589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-907cab9f-bd75-4bee-9933-5bf230898fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:50.718071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 666/1345] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:50.754974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:50.756814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:50.770712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909bd6-e190-469c-8ada-2e999b1460ac None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:50.774455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:50.775547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:50.775833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:50.776113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:50.785373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:50.786867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbbf6a-f70d-4065-8717-ea13a4c5a85a service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:50.796421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 680/1346] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:12:55.550328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf3c9-e6a0-414a-9cba-48635f606fa7 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:55.550898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf3c9-e6a0-414a-9cba-48635f606fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:55.550898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf3c9-e6a0-414a-9cba-48635f606fa7 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:55.552238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 667/1347] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:12:55.558528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0f19-e889-4cb3-b51e-38bcac3f8f9c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:55.558961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0f19-e889-4cb3-b51e-38bcac3f8f9c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:55.559129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0f19-e889-4cb3-b51e-38bcac3f8f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:55.577217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3e4e0f19-e889-4cb3-b51e-38bcac3f8f9c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:12:55.578399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3e4e0f19-e889-4cb3-b51e-38bcac3f8f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:12:55.586054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 681/1348] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:12:55.625341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf3c9-e6a0-414a-9cba-48635f606fa7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:12:55.636221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf3c9-e6a0-414a-9cba-48635f606fa7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:12:55.639801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:12:55.640442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:12:55.640728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:12:55.641005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:12:55.651300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:12:55.652744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767d2b3-8b93-4426-8527-86448048016e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:12:55.662576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 668/1349] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:13:01.046308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12b2e-1cc5-498d-b1e2-1e82ba13f7af None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:01.047197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12b2e-1cc5-498d-b1e2-1e82ba13f7af None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:01.047634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12b2e-1cc5-498d-b1e2-1e82ba13f7af None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:01.049451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 682/1350] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:01.054985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c581-d69a-44a5-83e6-3ba2005dcc8c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:01.056460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c581-d69a-44a5-83e6-3ba2005dcc8c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:01.057074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c581-d69a-44a5-83e6-3ba2005dcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:01.131566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-22f2c581-d69a-44a5-83e6-3ba2005dcc8c None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:01.133004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-22f2c581-d69a-44a5-83e6-3ba2005dcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:01.176440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:01.213505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 669/1351] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:13:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:05.571497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=80 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:05.639724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbd34-ceef-4562-93fe-c4da681d3b40 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:05.640091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbd34-ceef-4562-93fe-c4da681d3b40 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:05.640330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbd34-ceef-4562-93fe-c4da681d3b40 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:05.642369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 683/1352] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:05.648413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07371-e089-40c5-85c8-e47e12595613 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:05.648939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07371-e089-40c5-85c8-e47e12595613 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:05.650068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07371-e089-40c5-85c8-e47e12595613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:05.670816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-26d07371-e089-40c5-85c8-e47e12595613 None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:05.672219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26d07371-e089-40c5-85c8-e47e12595613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:05.682039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 670/1353] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:13:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:07.050779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e562-98be-45f1-ae5a-bd41f9932bb9 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:07.051354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e562-98be-45f1-ae5a-bd41f9932bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:07.051354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e562-98be-45f1-ae5a-bd41f9932bb9 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:07.052883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 684/1354] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:07.057759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5cb2-dab7-4548-b5a5-7f678800b810 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:07.058263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5cb2-dab7-4548-b5a5-7f678800b810 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:07.058362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5cb2-dab7-4548-b5a5-7f678800b810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:07.076139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-75cf5cb2-dab7-4548-b5a5-7f678800b810 None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:07.077323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-75cf5cb2-dab7-4548-b5a5-7f678800b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:07.085808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 671/1355] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:11.037552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77dc6-ad4c-48cc-980f-251cde6f2e2a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:11.038496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77dc6-ad4c-48cc-980f-251cde6f2e2a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:11.038920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77dc6-ad4c-48cc-980f-251cde6f2e2a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:11.041342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 685/1356] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:11.046804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837c59-2006-4745-8f75-5568d65dfcee None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:11.047290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837c59-2006-4745-8f75-5568d65dfcee None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:11.047380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837c59-2006-4745-8f75-5568d65dfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:11.065973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-24837c59-2006-4745-8f75-5568d65dfcee None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:11.067207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-24837c59-2006-4745-8f75-5568d65dfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:11.075777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 672/1357] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:11.127973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280421-d3b8-40fb-a1b1-0b485b50993a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:11.128886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280421-d3b8-40fb-a1b1-0b485b50993a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:11.129772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280421-d3b8-40fb-a1b1-0b485b50993a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:11.131685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 686/1358] 10.222.0.74 () {54 vars in 961 bytes} [Fri May 27 15:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:11.141563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f383ad-fe83-4f55-bc84-555e7aeb7599 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:11.142110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f383ad-fe83-4f55-bc84-555e7aeb7599 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:11.150739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f383ad-fe83-4f55-bc84-555e7aeb7599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:11.192382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d4f383ad-fe83-4f55-bc84-555e7aeb7599 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:11.196495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d4f383ad-fe83-4f55-bc84-555e7aeb7599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:11.293880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 673/1359] 10.222.0.74 () {58 vars in 1058 bytes} [Fri May 27 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:11.302295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04280421-d3b8-40fb-a1b1-0b485b50993a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:11.318965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04280421-d3b8-40fb-a1b1-0b485b50993a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:11.325825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:11.326562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:11.327113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:11.327470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:11.336231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:11.338820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d2b19-5817-4e2f-8593-1be90799eca8 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:11.349189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 687/1360] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:13.858482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbe46-cfdd-4eb5-9d70-7df1b6c1cb98 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:13.859086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbe46-cfdd-4eb5-9d70-7df1b6c1cb98 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:13.859086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cbe46-cfdd-4eb5-9d70-7df1b6c1cb98 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:13.860437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 674/1361] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:13.865664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44aaf-ef6f-4f97-ab90-dddb364057bd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:13.866086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44aaf-ef6f-4f97-ab90-dddb364057bd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:13.866222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44aaf-ef6f-4f97-ab90-dddb364057bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:13.884623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b4f44aaf-ef6f-4f97-ab90-dddb364057bd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:13.885735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b4f44aaf-ef6f-4f97-ab90-dddb364057bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:13.898873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 688/1362] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:13.941175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cbe46-cfdd-4eb5-9d70-7df1b6c1cb98 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:13.960976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cbe46-cfdd-4eb5-9d70-7df1b6c1cb98 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:13.968324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:13.969154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:13.969507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:13.969846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:13.979050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:13.980821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372735fc-4bfd-46a2-8051-fb52adcf47bf service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:13.990931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 675/1363] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:16.648188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e60e5-b2bb-4be6-a816-d122b6840ab1 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:16.648726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e60e5-b2bb-4be6-a816-d122b6840ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:16.648726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e60e5-b2bb-4be6-a816-d122b6840ab1 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:16.650438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 689/1364] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:16.655662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92bd1-44ff-4b16-8f93-96c884de457a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:16.656103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92bd1-44ff-4b16-8f93-96c884de457a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:16.656200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92bd1-44ff-4b16-8f93-96c884de457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:16.674356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-60b92bd1-44ff-4b16-8f93-96c884de457a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:16.675578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-60b92bd1-44ff-4b16-8f93-96c884de457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:16.684271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 676/1365] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:16.730774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67151-203c-4ed3-a022-86954890a186 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:16.732268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67151-203c-4ed3-a022-86954890a186 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:16.732268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67151-203c-4ed3-a022-86954890a186 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:16.733005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 690/1366] 10.222.0.74 () {54 vars in 961 bytes} [Fri May 27 15:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:16.738941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636f320-c084-4b27-8fbf-b2b69ed14ff3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:16.739242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636f320-c084-4b27-8fbf-b2b69ed14ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:16.739526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636f320-c084-4b27-8fbf-b2b69ed14ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:16.760427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4636f320-c084-4b27-8fbf-b2b69ed14ff3 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:16.761637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4636f320-c084-4b27-8fbf-b2b69ed14ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:16.778170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 677/1367] 10.222.0.74 () {58 vars in 1058 bytes} [Fri May 27 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:16.787157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff67151-203c-4ed3-a022-86954890a186 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:16.816130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff67151-203c-4ed3-a022-86954890a186 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:16.822685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:16.823335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:16.823622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:16.823910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:16.832559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:16.834126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d238a-c4a9-4b6c-8994-35ca4ea91dac service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:16.843661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 691/1368] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:19.258117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637811-0ff5-437c-af72-ce3bd7ac9ee5 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.258882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637811-0ff5-437c-af72-ce3bd7ac9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.258882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637811-0ff5-437c-af72-ce3bd7ac9ee5 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.260390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 678/1369] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:19.265672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81017d-c941-4ffc-83d8-b3e9a85a5725 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.266532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81017d-c941-4ffc-83d8-b3e9a85a5725 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.267314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81017d-c941-4ffc-83d8-b3e9a85a5725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.286185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6e81017d-c941-4ffc-83d8-b3e9a85a5725 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:19.287889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6e81017d-c941-4ffc-83d8-b3e9a85a5725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:19.297325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 692/1370] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:19.343303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa637811-0ff5-437c-af72-ce3bd7ac9ee5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:19.359440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa637811-0ff5-437c-af72-ce3bd7ac9ee5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:19.365348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:19.366021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.366308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.366633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.376641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:19.378268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d86e-648d-413e-8326-7d561c2db795 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:19.389326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 679/1371] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:19.536016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a7f1-3592-44f1-92ab-75e0f6001ff7 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.536215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a7f1-3592-44f1-92ab-75e0f6001ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.536491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a7f1-3592-44f1-92ab-75e0f6001ff7 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.537886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 693/1372] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:19.544930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffde10-b498-44e6-883e-60da3eda88f4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.545221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffde10-b498-44e6-883e-60da3eda88f4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.545499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffde10-b498-44e6-883e-60da3eda88f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.565114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-23ffde10-b498-44e6-883e-60da3eda88f4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:19.566331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-23ffde10-b498-44e6-883e-60da3eda88f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:19.575747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 680/1373] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:13:19.922873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a514-baa8-4ee1-80e7-bb1cef6f5e7e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.923375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a514-baa8-4ee1-80e7-bb1cef6f5e7e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.925593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a514-baa8-4ee1-80e7-bb1cef6f5e7e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.927634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 694/1374] 10.222.0.74 () {54 vars in 963 bytes} [Fri May 27 15:13:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:19.935098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47eaa-f14e-4c42-934d-1191a192f9d2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:19.935390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47eaa-f14e-4c42-934d-1191a192f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:19.939614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47eaa-f14e-4c42-934d-1191a192f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:19.962181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:19.987186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-23c47eaa-f14e-4c42-934d-1191a192f9d2 None None] MFA Rules not processed for user `f2be3143a237450a80f2fcb01a0c2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:19.988423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-23c47eaa-f14e-4c42-934d-1191a192f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:20.056494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 681/1375] 10.222.0.74 () {58 vars in 1060 bytes} [Fri May 27 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:20.064469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a514-baa8-4ee1-80e7-bb1cef6f5e7e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:20.079242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a514-baa8-4ee1-80e7-bb1cef6f5e7e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:20.083332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:20.084151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:20.084509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:20.084862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:20.095410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:20.096969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e3b78-6470-43a8-838f-ab4edb584a5c service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:20.107611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 695/1376] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:21.771379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ab40-dd55-433e-92cd-7a1092a439aa None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:21.771951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ab40-dd55-433e-92cd-7a1092a439aa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:21.771951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ab40-dd55-433e-92cd-7a1092a439aa None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:21.773322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 682/1377] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:21.779807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca80d-7b7b-413b-8d3b-09e12bb95728 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:21.780375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca80d-7b7b-413b-8d3b-09e12bb95728 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:21.780375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca80d-7b7b-413b-8d3b-09e12bb95728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:21.800062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4d9ca80d-7b7b-413b-8d3b-09e12bb95728 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:21.801317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4d9ca80d-7b7b-413b-8d3b-09e12bb95728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:21.810238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 696/1378] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:21.855839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ab40-dd55-433e-92cd-7a1092a439aa None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:21.870366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ab40-dd55-433e-92cd-7a1092a439aa None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:21.875936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:21.876591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:21.876876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:21.877150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:21.886289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:21.888024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d45be5-b56e-4619-9aa8-6f84000e5bee service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:21.900145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 683/1379] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:24.374232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258be6-9bf8-4286-853d-a7501b537031 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:24.374867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258be6-9bf8-4286-853d-a7501b537031 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:24.375125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258be6-9bf8-4286-853d-a7501b537031 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:24.376709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 697/1380] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:24.381948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029bcd-b36b-45f7-9c4e-8edfe888e96b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:24.382386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029bcd-b36b-45f7-9c4e-8edfe888e96b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:24.382535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029bcd-b36b-45f7-9c4e-8edfe888e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:24.402181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-33029bcd-b36b-45f7-9c4e-8edfe888e96b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:24.403437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-33029bcd-b36b-45f7-9c4e-8edfe888e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:24.412000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 684/1381] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:24.459832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258be6-9bf8-4286-853d-a7501b537031 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:24.474405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258be6-9bf8-4286-853d-a7501b537031 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:24.480793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:24.481587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:24.481872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:24.482152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:24.491130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:24.493431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840d696-ffd4-4431-bc43-0afd8b49dd4e service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:24.503231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 698/1382] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:26.891212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6ae9-bf44-46ff-b819-2b75efbc887b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:26.892752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6ae9-bf44-46ff-b819-2b75efbc887b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:26.893579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6ae9-bf44-46ff-b819-2b75efbc887b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:26.896664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 685/1383] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:26.902569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d34ed-4582-4b6c-8125-5078097d8f7b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:26.907136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d34ed-4582-4b6c-8125-5078097d8f7b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:26.907876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d34ed-4582-4b6c-8125-5078097d8f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:26.931481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4e2d34ed-4582-4b6c-8125-5078097d8f7b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:26.932776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4e2d34ed-4582-4b6c-8125-5078097d8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:26.941227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 699/1384] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:26.984133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc6ae9-bf44-46ff-b819-2b75efbc887b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:27.001866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc6ae9-bf44-46ff-b819-2b75efbc887b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:27.009350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:27.010099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:27.010500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:27.010871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:27.021211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:27.023015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559deb0d-196c-4994-b943-3f8a1a94fb8b service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:27.035323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 686/1385] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:29.523526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ffc8-f41e-41af-89dd-7fec1b756fc9 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:29.524227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ffc8-f41e-41af-89dd-7fec1b756fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:29.524380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19ffc8-f41e-41af-89dd-7fec1b756fc9 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:29.525782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 700/1386] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:29.531783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ce5a-88b1-46cb-a1d2-cfa1718730b5 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:29.532245 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ce5a-88b1-46cb-a1d2-cfa1718730b5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:29.532378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ce5a-88b1-46cb-a1d2-cfa1718730b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:29.551215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ab97ce5a-88b1-46cb-a1d2-cfa1718730b5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:29.552479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab97ce5a-88b1-46cb-a1d2-cfa1718730b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:29.561800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 687/1387] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:29.610268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19ffc8-f41e-41af-89dd-7fec1b756fc9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:29.626001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19ffc8-f41e-41af-89dd-7fec1b756fc9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:29.631474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:29.632124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:29.632409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:29.632689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:29.643088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:29.644770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b4459-cc27-4465-871e-ca7729665ce5 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:29.654344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 701/1388] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:32.020828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677689-c542-4d8a-a060-ddb21e542c11 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:32.021524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677689-c542-4d8a-a060-ddb21e542c11 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:32.021524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677689-c542-4d8a-a060-ddb21e542c11 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:32.022789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 688/1389] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:32.028308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634d6c-3cbd-4988-820e-dd53458417fd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:32.028768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634d6c-3cbd-4988-820e-dd53458417fd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:32.028875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634d6c-3cbd-4988-820e-dd53458417fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:32.046992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4b634d6c-3cbd-4988-820e-dd53458417fd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:32.048192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4b634d6c-3cbd-4988-820e-dd53458417fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:32.056536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 702/1390] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:32.103355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677689-c542-4d8a-a060-ddb21e542c11 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:32.118900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677689-c542-4d8a-a060-ddb21e542c11 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:32.124435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:32.125092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:32.125384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:32.125673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:32.134827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:32.136474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cccd2b-218d-4950-846a-9e8bf7783298 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:32.147278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 689/1391] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:34.581293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd1bf-4b03-4401-811a-03dd6f159da3 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:34.581913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd1bf-4b03-4401-811a-03dd6f159da3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:34.581913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd1bf-4b03-4401-811a-03dd6f159da3 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:34.583277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 703/1392] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:34.589717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cac6cf-f486-4f0e-adc0-f9ce2ca1f1b7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:34.590185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cac6cf-f486-4f0e-adc0-f9ce2ca1f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:34.590294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cac6cf-f486-4f0e-adc0-f9ce2ca1f1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:34.609066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-94cac6cf-f486-4f0e-adc0-f9ce2ca1f1b7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:34.610264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-94cac6cf-f486-4f0e-adc0-f9ce2ca1f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:34.619314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 690/1393] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:13:34.664201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd1bf-4b03-4401-811a-03dd6f159da3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:34.678837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd1bf-4b03-4401-811a-03dd6f159da3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:34.685087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:34.685742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:34.686023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:34.686299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:34.694985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:34.697579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2535-0252-46d5-8bb0-4d2a2edb08c7 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:34.707038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 704/1394] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:36.237524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24eaa1-1eac-4908-b16b-24c4d898e249 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:36.238138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24eaa1-1eac-4908-b16b-24c4d898e249 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:36.238138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24eaa1-1eac-4908-b16b-24c4d898e249 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:36.239559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 691/1395] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:36.245735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1109-14d0-42f1-97cc-bb0ab925fb08 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:36.246226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1109-14d0-42f1-97cc-bb0ab925fb08 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:36.246342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1109-14d0-42f1-97cc-bb0ab925fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:36.252425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=52 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:36.265583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e1bd1109-14d0-42f1-97cc-bb0ab925fb08 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:36.270863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e1bd1109-14d0-42f1-97cc-bb0ab925fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:36.275320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 705/1396] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:36.347894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea102f-abab-4f7f-add8-f1e634779b1b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:36.348216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea102f-abab-4f7f-add8-f1e634779b1b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:36.348532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea102f-abab-4f7f-add8-f1e634779b1b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:36.350050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 692/1397] 10.222.0.74 () {54 vars in 962 bytes} [Fri May 27 15:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:36.355927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd294ea9-ed58-4285-b6e5-2631cc9392c7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:36.356224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd294ea9-ed58-4285-b6e5-2631cc9392c7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:36.356512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd294ea9-ed58-4285-b6e5-2631cc9392c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:36.414931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fd294ea9-ed58-4285-b6e5-2631cc9392c7 None None] MFA Rules not processed for user `11e6cdc7569b419fa70ba6524b5a4c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:36.416578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd294ea9-ed58-4285-b6e5-2631cc9392c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:36.496761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 706/1398] 10.222.0.74 () {58 vars in 1059 bytes} [Fri May 27 15:13:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:36.504560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea102f-abab-4f7f-add8-f1e634779b1b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:36.516151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea102f-abab-4f7f-add8-f1e634779b1b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:36.520234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:36.520880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:36.521167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:36.521447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:36.530970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:36.532423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e330a0-0cec-49b0-bb7e-b405a7fc243f service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:36.543075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 693/1399] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:37.271329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66fe1-c042-4a71-ba0e-e8d7b27131c0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.271838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66fe1-c042-4a71-ba0e-e8d7b27131c0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.271938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66fe1-c042-4a71-ba0e-e8d7b27131c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.321187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-68f66fe1-c042-4a71-ba0e-e8d7b27131c0 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:37.322388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-68f66fe1-c042-4a71-ba0e-e8d7b27131c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:37.385433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 707/1400] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:37.430599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256080f-05ee-455d-999a-0ef98b2d0dac None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.431083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256080f-05ee-455d-999a-0ef98b2d0dac None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.431190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256080f-05ee-455d-999a-0ef98b2d0dac None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.431767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f494-f3ca-4364-a80d-193c42783ec8 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.432063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f494-f3ca-4364-a80d-193c42783ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.432371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f494-f3ca-4364-a80d-193c42783ec8 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.432677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 694/1401] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:37.433962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 708/1402] 10.222.0.74 () {54 vars in 942 bytes} [Fri May 27 15:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:13:37.437865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.438152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.438461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.440361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7390d-f4bb-4372-bdc4-d24d0aeabdd7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.440723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7390d-f4bb-4372-bdc4-d24d0aeabdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.441080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7390d-f4bb-4372-bdc4-d24d0aeabdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.456251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:37.457468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:37.465531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 695/1403] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:13:37.491643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-36f7390d-f4bb-4372-bdc4-d24d0aeabdd7 None None] MFA Rules not processed for user `29d1b699dac04f23bf3e2f6cd54d33a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:37.493397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-36f7390d-f4bb-4372-bdc4-d24d0aeabdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:37.507078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:37.510795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:37.523835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4db0-347f-4c55-b0bb-8d3e9e291521 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:37.529664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:37.530387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.540718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.540718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.541310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:37.542973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:37.553528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 696/1404] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:13:37.575511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 709/1405] 10.222.0.74 () {58 vars in 1039 bytes} [Fri May 27 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:37.585104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:37.596712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85e56-40f3-4f8c-a0f1-c7ea6f51137c service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:37.602325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:37.603022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:37.603311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:37.603576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:37.612480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:37.614071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bb973-68a6-4c77-9631-5f02199292d0 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:37.623256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 697/1406] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 15:13:39.967728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f597-aa7b-459a-9ad1-d55b57414390 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:39.968287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f597-aa7b-459a-9ad1-d55b57414390 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:39.968373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f597-aa7b-459a-9ad1-d55b57414390 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:39.969730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 710/1407] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:13:39.978617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b0c3-dc3e-4424-b257-eb7b0c1be232 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:39.979623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b0c3-dc3e-4424-b257-eb7b0c1be232 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:39.980238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b0c3-dc3e-4424-b257-eb7b0c1be232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:40.001893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b091b0c3-dc3e-4424-b257-eb7b0c1be232 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:13:40.003252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b091b0c3-dc3e-4424-b257-eb7b0c1be232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:13:40.013527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 698/1408] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:13:40.062564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f597-aa7b-459a-9ad1-d55b57414390 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:13:40.077765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f597-aa7b-459a-9ad1-d55b57414390 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:13:40.087635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:13:40.088310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:13:40.088597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:13:40.088875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:13:40.097966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:13:40.099941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154100-2d53-469d-8fa8-44a0e53f3cab service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:13:40.111518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 711/1409] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:13:50.277465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=82 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:50.278986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=30 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:02.406647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23485b3-401d-4d3a-9bac-5418b5c08148 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:02.407291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23485b3-401d-4d3a-9bac-5418b5c08148 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:02.407291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23485b3-401d-4d3a-9bac-5418b5c08148 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:02.408644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 699/1410] 10.222.0.74 () {54 vars in 918 bytes} [Fri May 27 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:02.413540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff00d5-b2cc-4521-952b-1a2b41aca825 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:02.414550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff00d5-b2cc-4521-952b-1a2b41aca825 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:02.414701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff00d5-b2cc-4521-952b-1a2b41aca825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:02.433352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4cff00d5-b2cc-4521-952b-1a2b41aca825 None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:02.434603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4cff00d5-b2cc-4521-952b-1a2b41aca825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:02.442902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 712/1411] 10.222.0.74 () {58 vars in 1015 bytes} [Fri May 27 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:02.456729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5ab-0d80-4b02-b7e7-c9a2bc2650cc None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:02.457014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5ab-0d80-4b02-b7e7-c9a2bc2650cc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:02.457292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a5ab-0d80-4b02-b7e7-c9a2bc2650cc None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:02.458670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 700/1412] 10.222.0.74 () {54 vars in 918 bytes} [Fri May 27 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:02.463995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d9fc-5f85-47a6-abb7-ed4e19caf926 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:02.464288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d9fc-5f85-47a6-abb7-ed4e19caf926 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:02.464570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d9fc-5f85-47a6-abb7-ed4e19caf926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:02.482606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c4e1d9fc-5f85-47a6-abb7-ed4e19caf926 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:02.483777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c4e1d9fc-5f85-47a6-abb7-ed4e19caf926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:02.492888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 713/1413] 10.222.0.74 () {58 vars in 1015 bytes} [Fri May 27 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:05.160467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd933f8-762b-4124-8b50-fb83cfab2526 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:05.161062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd933f8-762b-4124-8b50-fb83cfab2526 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:05.161062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd933f8-762b-4124-8b50-fb83cfab2526 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:05.162289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:05.167691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbac45-5ac9-4a1f-8b91-b49a70b2244f None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:05.168123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbac45-5ac9-4a1f-8b91-b49a70b2244f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:05.168257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbac45-5ac9-4a1f-8b91-b49a70b2244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:05.185590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3ecbac45-5ac9-4a1f-8b91-b49a70b2244f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:05.186830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3ecbac45-5ac9-4a1f-8b91-b49a70b2244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:05.194542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:05.236444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd933f8-762b-4124-8b50-fb83cfab2526 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:05.250613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd933f8-762b-4124-8b50-fb83cfab2526 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:05.255884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:05.256511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:05.256788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:05.257063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:05.265514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:05.267142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877dff-b867-49a9-8951-9c08268fff6a service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:05.277235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 702/1416] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:14:06.248341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a7f-d462-4917-8aaf-8772331a1e41 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:06.248913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a7f-d462-4917-8aaf-8772331a1e41 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:06.248913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a7f-d462-4917-8aaf-8772331a1e41 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:06.250279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:06.255256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6b3-95a8-4d72-b0ec-fb806636ff2b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:06.255674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6b3-95a8-4d72-b0ec-fb806636ff2b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:06.255824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6b3-95a8-4d72-b0ec-fb806636ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:06.274919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-269bd6b3-95a8-4d72-b0ec-fb806636ff2b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:06.276115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-269bd6b3-95a8-4d72-b0ec-fb806636ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:06.283989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:06.440700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a041a7f-d462-4917-8aaf-8772331a1e41 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:06.455894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a041a7f-d462-4917-8aaf-8772331a1e41 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:06.462249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:06.462922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:06.463211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:06.463488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:06.471493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:06.473062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05416e-4b5a-4aaf-8dae-84aa8fc03aac service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:06.482912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 716/1419] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:07.405016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f59c-4427-4295-92bb-079c8cf125c0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:07.405556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f59c-4427-4295-92bb-079c8cf125c0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:07.405556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f59c-4427-4295-92bb-079c8cf125c0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:07.407009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:07.411967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8244d-9c34-40de-a13d-fdd452da96a4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:07.412360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8244d-9c34-40de-a13d-fdd452da96a4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:07.412642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8244d-9c34-40de-a13d-fdd452da96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:07.431505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-70b8244d-9c34-40de-a13d-fdd452da96a4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:07.432689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-70b8244d-9c34-40de-a13d-fdd452da96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:07.440246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:07.588636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f59c-4427-4295-92bb-079c8cf125c0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:07.604058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f59c-4427-4295-92bb-079c8cf125c0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:07.609698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:07.610330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:07.610650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:07.610929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:07.619464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:07.621040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010896db-4df4-44bf-96c5-e080f16de17f service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:07.630527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 705/1422] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:08.529856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d703d-c0e9-47ac-9b19-07148e977b94 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:08.530453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d703d-c0e9-47ac-9b19-07148e977b94 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:08.530453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d703d-c0e9-47ac-9b19-07148e977b94 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:08.531850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:08.536649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0665-8740-47a2-b297-68151746a18f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:08.537059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0665-8740-47a2-b297-68151746a18f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:08.537185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0665-8740-47a2-b297-68151746a18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:08.555567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f07b0665-8740-47a2-b297-68151746a18f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:08.556751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f07b0665-8740-47a2-b297-68151746a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:08.564510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:08.720854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d703d-c0e9-47ac-9b19-07148e977b94 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:08.735714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d703d-c0e9-47ac-9b19-07148e977b94 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:08.741197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:08.741905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:08.742208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:08.742524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:08.750739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:08.752306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8919-b131-4810-874e-ce50f41f69af service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:08.762568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 719/1425] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:09.677760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cd17-da81-4cb9-891e-95b55a04e7de None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:09.678334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cd17-da81-4cb9-891e-95b55a04e7de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:09.678334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cd17-da81-4cb9-891e-95b55a04e7de None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:09.680341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:09.685515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d573d-bf7a-41fa-8274-c7927952e82a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:09.685959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d573d-bf7a-41fa-8274-c7927952e82a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:09.686057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d573d-bf7a-41fa-8274-c7927952e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:09.704190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-dc2d573d-bf7a-41fa-8274-c7927952e82a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:09.705405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dc2d573d-bf7a-41fa-8274-c7927952e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:09.713849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:09.868751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0cd17-da81-4cb9-891e-95b55a04e7de None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:09.883986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0cd17-da81-4cb9-891e-95b55a04e7de None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:09.889435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:09.890068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:09.890355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:09.890674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:09.899972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:09.901566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5195-be5d-40ed-9418-ca7cb518a379 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:09.911370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 708/1428] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:10.826349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcddd6b-ae17-48f3-ae86-17ab98035cb6 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:10.826910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcddd6b-ae17-48f3-ae86-17ab98035cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:10.827009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcddd6b-ae17-48f3-ae86-17ab98035cb6 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:10.828301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:10.833319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803acc-d759-498d-98ca-f8463223df8a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:10.833767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803acc-d759-498d-98ca-f8463223df8a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:10.833881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803acc-d759-498d-98ca-f8463223df8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:10.852268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-53803acc-d759-498d-98ca-f8463223df8a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:10.853545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-53803acc-d759-498d-98ca-f8463223df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:10.861460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:11.015433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcddd6b-ae17-48f3-ae86-17ab98035cb6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:11.029991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcddd6b-ae17-48f3-ae86-17ab98035cb6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:11.035247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:11.035884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:11.036170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:11.036451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:11.045549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:11.047195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261908f-6b25-4229-b75a-941e51a4fce3 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:11.058175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 722/1431] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:12.015774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f94c-6f28-4425-903c-748b4fc17c63 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:12.016325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f94c-6f28-4425-903c-748b4fc17c63 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:12.016325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f94c-6f28-4425-903c-748b4fc17c63 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:12.017720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:12.023035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82829e-d7a1-432a-b8ad-ffe5da863386 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:12.023462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82829e-d7a1-432a-b8ad-ffe5da863386 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:12.023678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82829e-d7a1-432a-b8ad-ffe5da863386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:12.041646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8d82829e-d7a1-432a-b8ad-ffe5da863386 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:12.042852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8d82829e-d7a1-432a-b8ad-ffe5da863386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:12.050456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:12.198472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961f94c-6f28-4425-903c-748b4fc17c63 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:12.213344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961f94c-6f28-4425-903c-748b4fc17c63 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:12.218844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:12.219480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:12.219765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:12.220045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:12.228820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:12.230435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3199e-59be-4c89-b04c-46a8861fe242 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:12.239719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 711/1434] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:13.195855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba492-7c4b-4c10-abc0-92c1152dfce0 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:13.196414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba492-7c4b-4c10-abc0-92c1152dfce0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:13.196414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba492-7c4b-4c10-abc0-92c1152dfce0 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:13.197785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:13.202889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919d71-03cc-4caa-901f-18405942677e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:13.203272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919d71-03cc-4caa-901f-18405942677e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:13.203453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919d71-03cc-4caa-901f-18405942677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:13.221296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-89919d71-03cc-4caa-901f-18405942677e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:13.222535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-89919d71-03cc-4caa-901f-18405942677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:13.231328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:13.379238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba492-7c4b-4c10-abc0-92c1152dfce0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:13.393868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba492-7c4b-4c10-abc0-92c1152dfce0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:13.399526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:13.400186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:13.400469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:13.400744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:13.408852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:13.410445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2033861-4d4c-4621-b135-f8923406d207 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:13.420124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 725/1437] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:14.342665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2a42-3264-4fe8-94bf-e809567898cb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:14.343195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2a42-3264-4fe8-94bf-e809567898cb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:14.343319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec2a42-3264-4fe8-94bf-e809567898cb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:14.344636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:14.349438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8ca2-c1a8-47ea-8783-e7411ac010ba None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:14.349866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8ca2-c1a8-47ea-8783-e7411ac010ba None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:14.349974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8ca2-c1a8-47ea-8783-e7411ac010ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:14.368263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a91e8ca2-c1a8-47ea-8783-e7411ac010ba None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:14.369436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a91e8ca2-c1a8-47ea-8783-e7411ac010ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:14.377037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:14.526770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec2a42-3264-4fe8-94bf-e809567898cb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:14.540944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec2a42-3264-4fe8-94bf-e809567898cb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:14.546340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:14.546997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:14.547281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:14.547558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:14.556230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:14.557805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1d3d-d1c4-43e8-a64d-aa36922a6a12 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:14.567223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 714/1440] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:16.662115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d02e2-fada-4dd4-a105-9284303274f6 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:16.662705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d02e2-fada-4dd4-a105-9284303274f6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:16.662705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d02e2-fada-4dd4-a105-9284303274f6 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:16.664842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:16.670260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa847-1f31-4456-a6a9-be182f3b519d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:16.670724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa847-1f31-4456-a6a9-be182f3b519d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:16.670845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa847-1f31-4456-a6a9-be182f3b519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:16.688980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-552fa847-1f31-4456-a6a9-be182f3b519d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:16.690184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-552fa847-1f31-4456-a6a9-be182f3b519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:16.698253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:16.739738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d02e2-fada-4dd4-a105-9284303274f6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:16.751704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d02e2-fada-4dd4-a105-9284303274f6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:16.755535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:16.756385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:16.756677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:16.756957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:16.767577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:16.769382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d019e-cb9c-4717-9bf8-d88300bf5977 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:16.779963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 728/1443] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:19.109356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14089-55a3-4baa-8ce4-dcdc36107b3c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:19.109893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14089-55a3-4baa-8ce4-dcdc36107b3c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:19.110093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14089-55a3-4baa-8ce4-dcdc36107b3c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:19.111477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:19.117163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0848-5d84-4227-a557-2d991f3cb98b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:19.117615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0848-5d84-4227-a557-2d991f3cb98b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:19.117744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0848-5d84-4227-a557-2d991f3cb98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:19.135769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-aa5f0848-5d84-4227-a557-2d991f3cb98b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:19.136987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aa5f0848-5d84-4227-a557-2d991f3cb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:19.144879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:19.182978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14089-55a3-4baa-8ce4-dcdc36107b3c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:19.193776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14089-55a3-4baa-8ce4-dcdc36107b3c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:19.198442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:19.199096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:19.199377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:19.199650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:19.208415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:19.209838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f9b35-a39e-43a7-b892-461c4883450f service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:19.219248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 717/1446] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:21.871622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee973-9a70-4ae5-b1c1-779d19ec2e70 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:21.872244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee973-9a70-4ae5-b1c1-779d19ec2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:21.872244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee973-9a70-4ae5-b1c1-779d19ec2e70 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:21.873936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:21.879469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d070d-0f77-4b7e-9098-bd050f544efa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:21.879902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d070d-0f77-4b7e-9098-bd050f544efa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:21.880037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d070d-0f77-4b7e-9098-bd050f544efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:21.900083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9e0d070d-0f77-4b7e-9098-bd050f544efa None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:21.901303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9e0d070d-0f77-4b7e-9098-bd050f544efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:21.909325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:21.949308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ee973-9a70-4ae5-b1c1-779d19ec2e70 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:21.961102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ee973-9a70-4ae5-b1c1-779d19ec2e70 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:21.964813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:21.965449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:21.965734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:21.966012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:21.975137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:21.979831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff160-af35-4a5a-80b5-4f35bede06cb service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:21.989214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 731/1449] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:24.293230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107645-1319-4880-b35e-a47492b0803d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:24.293784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107645-1319-4880-b35e-a47492b0803d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:24.293784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107645-1319-4880-b35e-a47492b0803d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:24.295169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:24.300358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3351cb-ab13-4fa8-b088-95ee650bb7c1 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:24.300740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3351cb-ab13-4fa8-b088-95ee650bb7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:24.300913 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3351cb-ab13-4fa8-b088-95ee650bb7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:24.318104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0b3351cb-ab13-4fa8-b088-95ee650bb7c1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:24.319316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0b3351cb-ab13-4fa8-b088-95ee650bb7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:24.327002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:24.364635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa107645-1319-4880-b35e-a47492b0803d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:24.375741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa107645-1319-4880-b35e-a47492b0803d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:24.379356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:24.380001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:24.380288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:24.380567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:24.389584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:24.391092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352dc5d-ab4a-45c5-894f-fca9edcb049e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:24.401725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 720/1452] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:26.638468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6199a3-5e79-485c-8ca8-edd7cd5a587e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:26.639059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6199a3-5e79-485c-8ca8-edd7cd5a587e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:26.639059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6199a3-5e79-485c-8ca8-edd7cd5a587e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:26.640423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:26.645844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec2cb-4704-4cea-8c1e-fab44a22f912 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:26.646237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec2cb-4704-4cea-8c1e-fab44a22f912 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:26.646395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec2cb-4704-4cea-8c1e-fab44a22f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:26.665217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b42ec2cb-4704-4cea-8c1e-fab44a22f912 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:26.666404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b42ec2cb-4704-4cea-8c1e-fab44a22f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:26.674154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:26.712243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6199a3-5e79-485c-8ca8-edd7cd5a587e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:26.723675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6199a3-5e79-485c-8ca8-edd7cd5a587e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:26.727251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:26.727883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:26.728180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:26.728445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:26.737236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:26.738704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af906-8d19-49db-bb39-01ac2468bc5d service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:26.748095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 734/1455] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:14:29.005568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b355-6ec6-453c-99ee-2eff7d7a87a5 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:29.006123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b355-6ec6-453c-99ee-2eff7d7a87a5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:29.006123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b355-6ec6-453c-99ee-2eff7d7a87a5 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:29.007763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:29.013275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257414-2539-48bb-b15a-6c0d80b89b55 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:29.013669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257414-2539-48bb-b15a-6c0d80b89b55 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:29.013846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76257414-2539-48bb-b15a-6c0d80b89b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:29.031668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-76257414-2539-48bb-b15a-6c0d80b89b55 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:29.032858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-76257414-2539-48bb-b15a-6c0d80b89b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:29.041283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:29.078660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b355-6ec6-453c-99ee-2eff7d7a87a5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:29.089537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b355-6ec6-453c-99ee-2eff7d7a87a5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:29.092985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:29.093608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:29.093887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:29.094160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:29.103462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:29.104879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7bef5-c596-4244-a9fa-6441c7860bf0 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:29.114082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 723/1458] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:31.369001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9395-d33a-4cd1-9aba-9131c0ca09b7 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:31.369589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9395-d33a-4cd1-9aba-9131c0ca09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:31.369589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9395-d33a-4cd1-9aba-9131c0ca09b7 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:31.371038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:31.376587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc2ac-b433-4e07-9c16-cd981e9ab9a6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:31.377191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc2ac-b433-4e07-9c16-cd981e9ab9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:31.377191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc2ac-b433-4e07-9c16-cd981e9ab9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:31.384224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=70 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:31.396652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8bccc2ac-b433-4e07-9c16-cd981e9ab9a6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:31.398509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8bccc2ac-b433-4e07-9c16-cd981e9ab9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:31.406363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:31.443595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9395-d33a-4cd1-9aba-9131c0ca09b7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:31.449594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=73 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:31.455248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9395-d33a-4cd1-9aba-9131c0ca09b7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:31.458856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:31.459493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:31.459781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:31.460698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:31.469632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:31.471130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ecb65-0783-491e-a0be-3a4a68a3272d service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:31.481756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 737/1461] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:33.724323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e5aec-6043-4190-ba4b-2ef666185d98 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:33.724875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e5aec-6043-4190-ba4b-2ef666185d98 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:33.724875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e5aec-6043-4190-ba4b-2ef666185d98 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:33.726829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:33.732103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ef57-ce10-4e40-a9ee-babb1283dd1e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:33.732530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ef57-ce10-4e40-a9ee-babb1283dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:33.732675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ef57-ce10-4e40-a9ee-babb1283dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:33.751277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4896ef57-ce10-4e40-a9ee-babb1283dd1e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:33.752474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4896ef57-ce10-4e40-a9ee-babb1283dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:33.760914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:33.798286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e5aec-6043-4190-ba4b-2ef666185d98 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:33.809741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e5aec-6043-4190-ba4b-2ef666185d98 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:33.813308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:33.813942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:33.814226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:33.814548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:33.823878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:33.825309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25c25-deb2-444e-8bef-84ced09c2fdc service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:33.834684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 726/1464] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:36.037661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5c2f-842d-4370-83e0-7ef122b73c71 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:36.038789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5c2f-842d-4370-83e0-7ef122b73c71 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:36.038886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5c2f-842d-4370-83e0-7ef122b73c71 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:36.040266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:36.045476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563dcc-b11f-435c-a44b-c68b3794fdc2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:36.045922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563dcc-b11f-435c-a44b-c68b3794fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:36.046043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563dcc-b11f-435c-a44b-c68b3794fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:36.064629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f1563dcc-b11f-435c-a44b-c68b3794fdc2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:36.065837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f1563dcc-b11f-435c-a44b-c68b3794fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:36.073684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:36.110893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5c2f-842d-4370-83e0-7ef122b73c71 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:36.121545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5c2f-842d-4370-83e0-7ef122b73c71 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:36.125045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:36.125677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:36.125967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:36.126250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:36.135386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:36.136821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2e3b-ef66-40d3-8f3f-a8b20804ca78 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:36.146316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 740/1467] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:38.469742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-8bcb-49fb-bc3a-f45eb8dd8481 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:38.470266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-8bcb-49fb-bc3a-f45eb8dd8481 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:38.470266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-8bcb-49fb-bc3a-f45eb8dd8481 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:38.471606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:14:38.477444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4277-a98d-4943-be92-010153a7e19d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:38.477854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4277-a98d-4943-be92-010153a7e19d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:38.478069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4277-a98d-4943-be92-010153a7e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:38.495637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-068d4277-a98d-4943-be92-010153a7e19d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:14:38.496841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-068d4277-a98d-4943-be92-010153a7e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:14:38.504523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:14:38.540983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d711-8bcb-49fb-bc3a-f45eb8dd8481 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:14:38.551816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d711-8bcb-49fb-bc3a-f45eb8dd8481 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:14:38.555409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:14:38.556041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:14:38.556433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:14:38.556711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:14:38.565521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:14:38.567002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942078-80cd-4b57-bdf5-c233662d1a8a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:14:38.576365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 729/1470] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:14:48.490660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=17 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:48.572275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=17 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:12.174656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce072b1-b9fe-4856-be7c-3b2cec730731 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:12.175230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce072b1-b9fe-4856-be7c-3b2cec730731 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:12.175230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce072b1-b9fe-4856-be7c-3b2cec730731 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:12.176598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 742/1471] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:12.181790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eb47-96ef-4e32-b54b-35a0e76bbf4c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:12.182237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eb47-96ef-4e32-b54b-35a0e76bbf4c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:12.182366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eb47-96ef-4e32-b54b-35a0e76bbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:12.199878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3764eb47-96ef-4e32-b54b-35a0e76bbf4c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:12.201067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3764eb47-96ef-4e32-b54b-35a0e76bbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:12.208768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 730/1472] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:12.255060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ba3f-5646-4c69-856e-5f56c9b7e223 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:12.255354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ba3f-5646-4c69-856e-5f56c9b7e223 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:12.255638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ba3f-5646-4c69-856e-5f56c9b7e223 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:12.256997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 743/1473] 10.222.0.74 () {54 vars in 962 bytes} [Fri May 27 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:12.261898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87e61-b447-4f18-9e47-e896d4bdd625 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:12.262184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87e61-b447-4f18-9e47-e896d4bdd625 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:12.262491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87e61-b447-4f18-9e47-e896d4bdd625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:12.280682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e1e87e61-b447-4f18-9e47-e896d4bdd625 None None] MFA Rules not processed for user `11e6cdc7569b419fa70ba6524b5a4c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:12.281857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e1e87e61-b447-4f18-9e47-e896d4bdd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:12.288174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 731/1474] 10.222.0.74 () {58 vars in 1059 bytes} [Fri May 27 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:15:12.295912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ba3f-5646-4c69-856e-5f56c9b7e223 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:12.306282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ba3f-5646-4c69-856e-5f56c9b7e223 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:12.309727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:12.310344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:12.310656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:12.310934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:12.319590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:12.320998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7600ad-49f9-4008-8710-4a1e22f5724d service glance] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:12.330119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 744/1475] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:15:14.641418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c76f-84e6-4915-9653-c2afbb27c6f6 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:14.641946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c76f-84e6-4915-9653-c2afbb27c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:14.641946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c76f-84e6-4915-9653-c2afbb27c6f6 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:14.643339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 732/1476] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:14.648896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebac1-b8f1-49c6-a424-856432f092cc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:14.649291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebac1-b8f1-49c6-a424-856432f092cc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:14.649453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebac1-b8f1-49c6-a424-856432f092cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:14.667881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6edebac1-b8f1-49c6-a424-856432f092cc None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:14.669056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6edebac1-b8f1-49c6-a424-856432f092cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:14.676866 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 745/1477] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:14.700855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c76f-84e6-4915-9653-c2afbb27c6f6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:14.714141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c76f-84e6-4915-9653-c2afbb27c6f6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:14.718705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:14.719351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:14.719634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:14.719909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:14.720636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:14.722634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:15:14.722634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:15:14.722634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:15:14.723787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3c441-490d-4183-afa5-72d4bfc7c126 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:14.744262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 733/1478] 10.222.0.74 () {56 vars in 1108 bytes} [Fri May 27 15:15:14 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:15:17.005203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151c28-82e1-4e6e-b65d-034bd4d5a725 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:17.005761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151c28-82e1-4e6e-b65d-034bd4d5a725 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:17.005871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151c28-82e1-4e6e-b65d-034bd4d5a725 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:17.007273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 746/1479] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:17.012564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50118-b5da-41f6-8be7-bff96384067f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:17.013014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50118-b5da-41f6-8be7-bff96384067f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:17.013112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50118-b5da-41f6-8be7-bff96384067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:17.031269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-27e50118-b5da-41f6-8be7-bff96384067f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:17.032473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-27e50118-b5da-41f6-8be7-bff96384067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:17.040765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 734/1480] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:17.083613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151c28-82e1-4e6e-b65d-034bd4d5a725 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:17.097823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151c28-82e1-4e6e-b65d-034bd4d5a725 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:17.104146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:17.104794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:17.105085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:17.105368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:17.113763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:17.115370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c7a9f-dada-49ac-9d2b-2e9a55eb79c8 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:17.125405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 747/1481] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:15:19.550902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676ae1-211c-40d6-9b44-d3c0d4a1e4bf None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:19.551475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676ae1-211c-40d6-9b44-d3c0d4a1e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:19.551475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676ae1-211c-40d6-9b44-d3c0d4a1e4bf None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:19.552841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 735/1482] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:19.558852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e549e8-b25c-40f5-9d03-2d963ac559fc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:19.559258 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e549e8-b25c-40f5-9d03-2d963ac559fc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:19.559408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e549e8-b25c-40f5-9d03-2d963ac559fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:19.577850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b4e549e8-b25c-40f5-9d03-2d963ac559fc None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:19.579080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b4e549e8-b25c-40f5-9d03-2d963ac559fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:19.587861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 748/1483] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:19.623276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676ae1-211c-40d6-9b44-d3c0d4a1e4bf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:19.634562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676ae1-211c-40d6-9b44-d3c0d4a1e4bf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:19.638099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:19.638768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:19.639052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:19.639326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:19.649180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:19.650638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692447a-62d2-4334-971b-b2f49a2a7f83 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:19.659934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 736/1484] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:15:21.953085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1135-88c6-4d1e-827d-00f3931f2e6e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:21.953580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1135-88c6-4d1e-827d-00f3931f2e6e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:21.953696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1135-88c6-4d1e-827d-00f3931f2e6e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:21.955122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 749/1485] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:21.961518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cca7-d335-474d-a8d0-fb5442e272b8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:21.961982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cca7-d335-474d-a8d0-fb5442e272b8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:21.962089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cca7-d335-474d-a8d0-fb5442e272b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:21.980387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-efc5cca7-d335-474d-a8d0-fb5442e272b8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:21.981589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-efc5cca7-d335-474d-a8d0-fb5442e272b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:21.989341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 737/1486] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:22.028152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1135-88c6-4d1e-827d-00f3931f2e6e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:22.039430 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1135-88c6-4d1e-827d-00f3931f2e6e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:22.043117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:22.043763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:22.044051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:22.044337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:22.053340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:22.054939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bf141-8aea-4e95-8911-f930413f34d2 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:22.064526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 750/1487] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:15:24.387666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952b67-e492-4dd5-9591-4f7040f2f9a4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:24.388257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952b67-e492-4dd5-9591-4f7040f2f9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:24.388257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952b67-e492-4dd5-9591-4f7040f2f9a4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:24.389589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 738/1488] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:24.395334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f006-5260-426e-acbe-4ca8e0266c0c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:24.395783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f006-5260-426e-acbe-4ca8e0266c0c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:24.395886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f006-5260-426e-acbe-4ca8e0266c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:24.416494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-34d9f006-5260-426e-acbe-4ca8e0266c0c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:24.417704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-34d9f006-5260-426e-acbe-4ca8e0266c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:24.425565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 751/1489] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:24.466045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952b67-e492-4dd5-9591-4f7040f2f9a4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:24.476928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952b67-e492-4dd5-9591-4f7040f2f9a4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:24.480490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:24.481125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:24.481410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:24.481690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:24.490609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:24.492202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f235c-d7fb-4953-9092-3ef78890faf3 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:24.501539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 739/1490] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:15:27.096896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3296d-9348-426e-b408-fe5c0d6bd8de None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:27.097459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3296d-9348-426e-b408-fe5c0d6bd8de None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:27.097459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3296d-9348-426e-b408-fe5c0d6bd8de None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:27.098882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 752/1491] 10.222.0.74 () {54 vars in 926 bytes} [Fri May 27 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:15:27.104663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fb84-f2cb-4a4a-b60b-111e3cbc8aa3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:27.105094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fb84-f2cb-4a4a-b60b-111e3cbc8aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:27.105233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fb84-f2cb-4a4a-b60b-111e3cbc8aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:27.122979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0ce7fb84-f2cb-4a4a-b60b-111e3cbc8aa3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:15:27.124188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0ce7fb84-f2cb-4a4a-b60b-111e3cbc8aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:15:27.132052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 740/1492] 10.222.0.74 () {58 vars in 1023 bytes} [Fri May 27 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:15:27.171522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3296d-9348-426e-b408-fe5c0d6bd8de None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:15:27.182531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3296d-9348-426e-b408-fe5c0d6bd8de None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:15:27.186080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:15:27.186751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:15:27.187039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:15:27.187316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:15:27.196315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:15:27.197756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7d02f-2c13-4475-9648-c15914139ecb service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:15:27.207092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 753/1493] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:15:37.117743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=33 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:37.202940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=33 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:15.554681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.555290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.555290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.574192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:17:15.575440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:15.584070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 741/1494] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:17:15.593325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.593886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.593988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.612488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:17:15.613814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:15.621654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 754/1495] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:17:15.626950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:15.636762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2ace4-471e-489b-a87b-c5c8a174ad6a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:15.641456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:15.642107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.642388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.642695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.643415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:17:15.643772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:15.644786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:15.644786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:17:15.644786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:17:15.645674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:15.657396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 742/1496] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:17:15.665357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:15.675208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821d9d-ae5d-4bc4-b25e-c1b7c57f0f03 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:15.679701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:15.680342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.680625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.680900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.681629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:15.683453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:15.683453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:17:15.683453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:17:15.684634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:15.799656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 755/1497] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:17:15 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:17:15.803991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:15.815335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ca7b3-ab2b-455f-8dcc-340067797222 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:15.870368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:15.871072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.871336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.871612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.872297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:15.873316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:15.873316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:17:15.873316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:17:15.875207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:15.929038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 743/1498] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:17:15 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:17:15.933388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:15.944459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9156fc-1d5d-4073-ad7e-ce14036c43c6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:15.948942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:15.949600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.949885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.950163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.950931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:15.951940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:15.951940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:17:15.951940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:17:15.952848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:15.965361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 756/1499] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:17:15.970771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:15.980705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca99a3-995b-46aa-8816-532e098a8db7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:15.986173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:15.986872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:15.987190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:15.987468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:15.988198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:15.989225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:15.989225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:17:15.989225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:17:15.990099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0a7b-d204-41be-a6b8-9a3f05d64a0d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:16.004878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 744/1500] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:17:16.009457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:16.019510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a229a-f207-4119-afd3-6fe73c37d823 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:16.024266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:16.025143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.025435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.025713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] PATH_INFO: `/v3/projects/c01386acca984560b92974c81a262aaa/users/a09a4b6aa6dd4e8391619c0bf93ecc48/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.041062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01386acca984560b92974c81a262aaa, user_id=a09a4b6aa6dd4e8391619c0bf93ecc48, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:16.042093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:16.042093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:17:16.042093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:17:16.044059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e92a-89d0-4f27-9b83-e4a5ad143906 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:16.112338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 757/1501] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:17:16 2022] PUT /identity/v3/projects/c01386acca984560b92974c81a262aaa/users/a09a4b6aa6dd4e8391619c0bf93ecc48/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:17:16.123923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152950-7ffb-4895-9446-7b110ed96834 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.124347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152950-7ffb-4895-9446-7b110ed96834 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.124743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152950-7ffb-4895-9446-7b110ed96834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.150662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-74152950-7ffb-4895-9446-7b110ed96834 None None] MFA Rules not processed for user `a09a4b6aa6dd4e8391619c0bf93ecc48`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:17:16.151872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-74152950-7ffb-4895-9446-7b110ed96834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:16.221040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 745/1502] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:17:16.235209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77c24-fd7a-4281-a8e4-e28e4d2b6d3c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.235505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77c24-fd7a-4281-a8e4-e28e4d2b6d3c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.235791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77c24-fd7a-4281-a8e4-e28e4d2b6d3c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.237302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 758/1503] 10.222.0.74 () {54 vars in 963 bytes} [Fri May 27 15:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:17:16.242723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3a41-020a-4014-b6ca-083bee000040 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.243015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3a41-020a-4014-b6ca-083bee000040 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.243290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3a41-020a-4014-b6ca-083bee000040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.261250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5eae3a41-020a-4014-b6ca-083bee000040 None None] MFA Rules not processed for user `f2be3143a237450a80f2fcb01a0c2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:17:16.262665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5eae3a41-020a-4014-b6ca-083bee000040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:16.307054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:16.314520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 746/1504] 10.222.0.74 () {58 vars in 1060 bytes} [Fri May 27 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:17:16.328011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de77c24-fd7a-4281-a8e4-e28e4d2b6d3c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:16.333595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de77c24-fd7a-4281-a8e4-e28e4d2b6d3c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:16.337116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:16.337751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.338039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.338320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.347250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:16.348675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:16.357428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 759/1505] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:17:16.399795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36508-ddd1-4a81-ae47-2a772b461811 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.400087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36508-ddd1-4a81-ae47-2a772b461811 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.400366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36508-ddd1-4a81-ae47-2a772b461811 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.401652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 747/1506] 10.222.0.74 () {52 vars in 829 bytes} [Fri May 27 15:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:17:16.405824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:16.466405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615ac7-221e-4d49-9f24-2cd2cb9e9327 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:16.471827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:16.472698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.472986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.473263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] PATH_INFO: `/v3/users/a09a4b6aa6dd4e8391619c0bf93ecc48` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.474460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09a4b6aa6dd4e8391619c0bf93ecc48)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:16.475477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:16.475477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:17:16.475477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:17:16.476683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:16.707163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09a4b6aa6dd4e8391619c0bf93ecc48'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:16.791900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09a4b6aa6dd4e8391619c0bf93ecc48'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:16.792604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09a4b6aa6dd4e8391619c0bf93ecc48'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:16.805299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09a4b6aa6dd4e8391619c0bf93ecc48'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:16.822102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:16.824520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09a4b6aa6dd4e8391619c0bf93ecc48'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:16.831180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 760/1507] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:17:16 2022] DELETE /identity/v3/users/a09a4b6aa6dd4e8391619c0bf93ecc48 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:17:16.837198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:16.837198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:16.837198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:16.854206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:17:16.855485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:16.914762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 748/1508] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:17:16.933727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:16.935204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:16.996742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cb37-7536-4436-8f0d-e3c2597b4242 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:17.001094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:17.001948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:17.002225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:17.002528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:17.011631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:17.013216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ac28-28f1-443f-9277-6cc8cde99d6e service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:17.023770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 761/1509] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:17:17.485023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:17:17.490691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:17:17.499472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3224a5c-541b-4649-91df-e8ceb9f49424 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:17:17.505173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] PATH_INFO: `/v3/projects/c01386acca984560b92974c81a262aaa` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01386acca984560b92974c81a262aaa)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:17:17.512135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:17:17.513505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:17:17.615430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01386acca984560b92974c81a262aaa', 'request_id': 'req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:17.621432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01386acca984560b92974c81a262aaa', 'request_id': 'req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:17.635497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01386acca984560b92974c81a262aaa', 'request_id': 'req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:17.694816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] The token cache is being invalidate because project c01386acca984560b92974c81a262aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:17:17.695104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:17.695851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c13ff869-ddc6-4937-ad2c-7ce76111f7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:17:17.697411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 749/1510] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:17:17 2022] DELETE /identity/v3/projects/c01386acca984560b92974c81a262aaa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:17:27.019543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:27.691630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:08.666472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:08.667048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:08.667048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:08.668325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:08.673328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61997a-e12a-4d0d-95f6-67b7c80f1954 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:08.673823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61997a-e12a-4d0d-95f6-67b7c80f1954 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:08.674228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61997a-e12a-4d0d-95f6-67b7c80f1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:08.692773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ba61997a-e12a-4d0d-95f6-67b7c80f1954 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:08.693978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ba61997a-e12a-4d0d-95f6-67b7c80f1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:08.752026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:08.925375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:08.927077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:08.999991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660dfa8-a528-4d9a-b4c2-f5286cb141f3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:09.005286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:09.005934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:09.006217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:09.006526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:09.014990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:09.016618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73551-dad8-4104-9b4b-ba6bab0460d1 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:09.026330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 763/1513] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:09.916513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe0714-2691-4ed6-bad0-1ec58ac8e44a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:09.916976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe0714-2691-4ed6-bad0-1ec58ac8e44a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:09.917087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe0714-2691-4ed6-bad0-1ec58ac8e44a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:09.918491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:09.924649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be003c-7aa7-433f-82b4-81d6ecfc20a5 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:09.924649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be003c-7aa7-433f-82b4-81d6ecfc20a5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:09.924649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be003c-7aa7-433f-82b4-81d6ecfc20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:09.943341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f0be003c-7aa7-433f-82b4-81d6ecfc20a5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:09.944573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f0be003c-7aa7-433f-82b4-81d6ecfc20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:09.953228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:10.110256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe0714-2691-4ed6-bad0-1ec58ac8e44a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:10.124649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe0714-2691-4ed6-bad0-1ec58ac8e44a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:10.130007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:10.130681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:10.130972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:10.131254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:10.139907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:10.141509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d917-e267-4bf8-bb30-c9937168138e service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:10.151957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 752/1516] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:10.450267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c7ed-d548-4bbc-b7b5-a45d0bc23d0d None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:10.450594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c7ed-d548-4bbc-b7b5-a45d0bc23d0d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:10.450877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c7ed-d548-4bbc-b7b5-a45d0bc23d0d None None] PATH_INFO: `/v3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:10.452293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 765/1517] 10.222.0.77 () {54 vars in 925 bytes} [Fri May 27 15:19:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:19:10.461941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b691-b7b4-4330-a711-e839f70535ee None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:10.462233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b691-b7b4-4330-a711-e839f70535ee None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:10.462544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b691-b7b4-4330-a711-e839f70535ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:10.481913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-15c5b691-b7b4-4330-a711-e839f70535ee None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:10.483191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-15c5b691-b7b4-4330-a711-e839f70535ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:10.544094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 753/1518] 10.222.0.77 () {58 vars in 1015 bytes} [Fri May 27 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:19.937910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=37 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:20.535809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=62 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:20.910543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f815-57b3-4742-b50a-8e09d474807a None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:20.910840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f815-57b3-4742-b50a-8e09d474807a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:20.911120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f815-57b3-4742-b50a-8e09d474807a None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:20.912498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 766/1519] 10.222.0.74 () {54 vars in 960 bytes} [Fri May 27 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:20.917586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c96a-7e84-4b72-928c-365f531f4aba None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:20.917875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c96a-7e84-4b72-928c-365f531f4aba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:20.918155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c96a-7e84-4b72-928c-365f531f4aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:20.936787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-14d7c96a-7e84-4b72-928c-365f531f4aba None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:20.937927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-14d7c96a-7e84-4b72-928c-365f531f4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:20.946305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 754/1520] 10.222.0.74 () {58 vars in 1057 bytes} [Fri May 27 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:19:20.954373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f815-57b3-4742-b50a-8e09d474807a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:20.974108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f815-57b3-4742-b50a-8e09d474807a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:20.979153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:20.979795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:20.980084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:20.980363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:20.988567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:20.990152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14a8d8-8e97-4313-9b71-14f4924828ed service placement] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:21.000610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 767/1521] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:21.440468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63040-165e-4506-989f-aec511588e3d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:21.440757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63040-165e-4506-989f-aec511588e3d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:21.441039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63040-165e-4506-989f-aec511588e3d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:21.442622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:21.448039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a6cc-5722-43a0-94cb-83a1c6732b3b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:21.449573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a6cc-5722-43a0-94cb-83a1c6732b3b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:21.449573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a6cc-5722-43a0-94cb-83a1c6732b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:21.466997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3c46a6cc-5722-43a0-94cb-83a1c6732b3b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:21.468204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3c46a6cc-5722-43a0-94cb-83a1c6732b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:21.476070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:21.634491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63040-165e-4506-989f-aec511588e3d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:21.649975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63040-165e-4506-989f-aec511588e3d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:21.656071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:21.657288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:21.657288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:21.657288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:21.665661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:21.667360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6a915-4f2b-4637-928b-e8532275b10b service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:21.676905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 756/1524] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:22.551290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604789-da62-4dc1-b79f-2070a283e4ff None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:22.551848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604789-da62-4dc1-b79f-2070a283e4ff None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:22.551848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604789-da62-4dc1-b79f-2070a283e4ff None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:22.553227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 15:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:22.558558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb822da-e958-4d76-962c-535d4df43677 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:22.558853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb822da-e958-4d76-962c-535d4df43677 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:22.559130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb822da-e958-4d76-962c-535d4df43677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:22.577690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8eb822da-e958-4d76-962c-535d4df43677 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:22.578862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8eb822da-e958-4d76-962c-535d4df43677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:22.586627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:22.737072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604789-da62-4dc1-b79f-2070a283e4ff None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:22.751452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604789-da62-4dc1-b79f-2070a283e4ff None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:22.756872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:22.757512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:22.757802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:22.758085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:22.766292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:22.767909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445c8d-6c88-449c-bd58-00704a3ea7ac service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:22.777865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 770/1527] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:26.928899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:26.929417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:26.929417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:26.930858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:26.936170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914c82-9220-4827-b994-d272a0e68a6a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:26.936615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914c82-9220-4827-b994-d272a0e68a6a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:26.936772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914c82-9220-4827-b994-d272a0e68a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:26.954816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-54914c82-9220-4827-b994-d272a0e68a6a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:26.956029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-54914c82-9220-4827-b994-d272a0e68a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:26.964622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:27.001816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:27.003657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:27.060246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b766b2-f20f-40aa-b3c5-534ee8d13044 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:27.063828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:27.064481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:27.064757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:27.065038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:27.073892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:27.075281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd996-bab8-4b70-99d2-04a47a6a2ba4 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:27.084511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 759/1530] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:29.353331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc47a2-b7a9-49fe-be29-31342af27d1c None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:29.353981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc47a2-b7a9-49fe-be29-31342af27d1c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:29.353981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc47a2-b7a9-49fe-be29-31342af27d1c None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:29.356023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:29.361492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2070d-6fa9-4544-910c-943690483fb9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:29.361955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2070d-6fa9-4544-910c-943690483fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:29.362064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2070d-6fa9-4544-910c-943690483fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:29.380055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-02f2070d-6fa9-4544-910c-943690483fb9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:29.381242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-02f2070d-6fa9-4544-910c-943690483fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:29.389320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:29.425509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc47a2-b7a9-49fe-be29-31342af27d1c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:29.436423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc47a2-b7a9-49fe-be29-31342af27d1c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:29.439877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:29.440503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:29.440787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:29.441063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:29.449935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:29.451383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90973b3-8936-4ceb-920c-901718610de2 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:29.460497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 773/1533] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:19:33.447058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:33.447627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:33.447627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:33.449153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:33.454350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c14a-7681-458e-9852-149363da5200 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:33.454818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c14a-7681-458e-9852-149363da5200 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:33.454921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c14a-7681-458e-9852-149363da5200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:33.472932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d742c14a-7681-458e-9852-149363da5200 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:33.474118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d742c14a-7681-458e-9852-149363da5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:33.482548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:33.760146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:33.762319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:33.825874 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28436-3cbf-4bf3-932b-b22ace121c88 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:33.829395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:33.830036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:33.830318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:33.830623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:33.839985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:33.841415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd671de-6f3c-4389-bfe1-14059a05f786 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:33.851004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 762/1536] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:36.080234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:36.080796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:36.080796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:36.082263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 15:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:19:36.087570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06228-fe8e-42ff-bed0-a5fffe8415c6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:36.087989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06228-fe8e-42ff-bed0-a5fffe8415c6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:36.088124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06228-fe8e-42ff-bed0-a5fffe8415c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:36.107234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a3b06228-fe8e-42ff-bed0-a5fffe8415c6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:19:36.108442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a3b06228-fe8e-42ff-bed0-a5fffe8415c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:36.116304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:19:36.400017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:19:36.402365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:19:36.415195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcf0aa-b915-45a8-8d86-bbe7dae99d31 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:19:36.419433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:19:36.420066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:19:36.420351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:19:36.420630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:19:36.429537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:19:36.430976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9669-9af6-4e2b-929c-da5bbb154843 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:19:36.440755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 776/1539] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:19:46.101436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=70 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:46.436716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=33 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:12.815421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5fe-3409-40b9-b03b-88af2619f07e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:12.816826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5fe-3409-40b9-b03b-88af2619f07e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:12.817432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5fe-3409-40b9-b03b-88af2619f07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:12.851855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f6dfa5fe-3409-40b9-b03b-88af2619f07e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:12.853093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f6dfa5fe-3409-40b9-b03b-88af2619f07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:12.875418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 764/1540] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:12.887322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331869e-3161-4150-a65c-89057cdcb7bd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:12.887892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331869e-3161-4150-a65c-89057cdcb7bd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:12.887892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331869e-3161-4150-a65c-89057cdcb7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:12.923816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4595-3389-4b57-9f4a-1fa5debe7ada None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:12.924155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4595-3389-4b57-9f4a-1fa5debe7ada None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:12.924379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4595-3389-4b57-9f4a-1fa5debe7ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:12.939929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8331869e-3161-4150-a65c-89057cdcb7bd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:12.942114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8331869e-3161-4150-a65c-89057cdcb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:12.965847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6f0c4595-3389-4b57-9f4a-1fa5debe7ada None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:12.967020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 777/1541] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:12.967159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6f0c4595-3389-4b57-9f4a-1fa5debe7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:12.968683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc09ae-fa77-498b-9ed5-7294f3473010 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:12.969192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc09ae-fa77-498b-9ed5-7294f3473010 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:12.970228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc09ae-fa77-498b-9ed5-7294f3473010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:12.980432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 765/1542] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:12.981752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:12.982079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:12.982294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.005033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2cfc09ae-fa77-498b-9ed5-7294f3473010 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.006401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2cfc09ae-fa77-498b-9ed5-7294f3473010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.015209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.016172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 778/1543] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.016564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.026705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c99de-ddd0-4c30-b214-9ea59b7c91f2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.026705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c99de-ddd0-4c30-b214-9ea59b7c91f2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.026705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c99de-ddd0-4c30-b214-9ea59b7c91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.038173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 766/1544] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.038173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.042708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3106c0-9d81-439d-954c-844e4d1cab1b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.047343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7c5c99de-ddd0-4c30-b214-9ea59b7c91f2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.047593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.048275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.048561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.048770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7c5c99de-ddd0-4c30-b214-9ea59b7c91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.048887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.049555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.049862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.052730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbfbf-4806-4ab2-90a9-1781b03997dc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.057823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 779/1545] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.058894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a62451-4822-498e-8c0b-93fdd60980ec None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.059189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a62451-4822-498e-8c0b-93fdd60980ec None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.059473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a62451-4822-498e-8c0b-93fdd60980ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.067047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 767/1546] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.067567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b23f76-92c0-447e-ac19-b852f42ae302 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.067833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b23f76-92c0-447e-ac19-b852f42ae302 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.068109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b23f76-92c0-447e-ac19-b852f42ae302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.079504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-80a62451-4822-498e-8c0b-93fdd60980ec None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.080723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-80a62451-4822-498e-8c0b-93fdd60980ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.088495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-85b23f76-92c0-447e-ac19-b852f42ae302 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.089699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-85b23f76-92c0-447e-ac19-b852f42ae302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.097881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 780/1547] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.097881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46fa7-819d-48f2-a354-2449c1b15c22 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.097881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46fa7-819d-48f2-a354-2449c1b15c22 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.097881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46fa7-819d-48f2-a354-2449c1b15c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.098341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 768/1548] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.099286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571af33-c5dc-459f-adff-e6bd9eb7fb82 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.099579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571af33-c5dc-459f-adff-e6bd9eb7fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.099857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571af33-c5dc-459f-adff-e6bd9eb7fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.125928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fca46fa7-819d-48f2-a354-2449c1b15c22 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.127003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d571af33-c5dc-459f-adff-e6bd9eb7fb82 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.127154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fca46fa7-819d-48f2-a354-2449c1b15c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.128175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d571af33-c5dc-459f-adff-e6bd9eb7fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.136015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 781/1549] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.145530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 769/1550] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.145718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38702fa7-267e-4a21-9829-07c1374fd24b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.145718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38702fa7-267e-4a21-9829-07c1374fd24b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.145935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.146034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38702fa7-267e-4a21-9829-07c1374fd24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.146130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.146130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.158955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-38702fa7-267e-4a21-9829-07c1374fd24b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.160304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-38702fa7-267e-4a21-9829-07c1374fd24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.160994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.162171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.168071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 782/1551] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.169284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.169583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.169854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.170984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 770/1552] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.171623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.182521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8ac3-ad99-4b8a-aafa-13e4ac02d3be None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.186992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.187646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.188059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.188338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.189016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.190041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:13.190041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:21:13.190041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:21:13.192377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.192596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.197473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.201994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 783/1553] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.202745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.212555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecc841-cf00-48e5-b29c-43317b5103a0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.217062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.220150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.220150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.220150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.220150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.220150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.220613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:13.220613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:21:13.220613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:21:13.221217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fff38-06df-44f4-953b-b3001dc4561f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.233570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 784/1554] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.234772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.235063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.235346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.253718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.254999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.262859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 785/1555] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.263747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.273730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac216-48b4-4500-b1ba-7bad02ef16ef None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.278295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.278956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.279240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.279515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.280243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.280548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.282115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59649212-06ba-4238-8558-82c121455e13 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.296554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 786/1556] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.301926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a09-7f43-4bf9-bc7f-bb850d29f995 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.301926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a09-7f43-4bf9-bc7f-bb850d29f995 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.301926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a09-7f43-4bf9-bc7f-bb850d29f995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.303719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 771/1557] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.304841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.321616 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-13804a09-7f43-4bf9-bc7f-bb850d29f995 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.322780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-13804a09-7f43-4bf9-bc7f-bb850d29f995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.367388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d882e-01c0-4a54-9165-7fac25d625d7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.371869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.372530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.372809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.373088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.373831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.374143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.375767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.385592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 787/1558] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.386942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.387238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.387550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.392224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 772/1559] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.393174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.407949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4f547-80a7-494e-8afc-99e066395515 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.412835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.413490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.413772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.414048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.414866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.415178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.416772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.420306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:13.421513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:13.429860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 773/1560] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.430737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.438560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 788/1561] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:13.439551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.440547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3349eb-8ca8-426a-919d-ea9da6967a66 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.446313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.446995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.447308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.447580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.448373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.449877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e26fd-6424-4296-b91d-4b8b1c8be4c7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.450280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.454836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.455620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.456037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.456443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.457289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.457852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.459716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.472707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 789/1562] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.473587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.483133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2e31-4a79-44c0-9e1e-844953475991 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.487599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.488819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.489290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.489584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.490302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.491353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:13.491353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:21:13.491353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:21:13.492562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.575936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 774/1563] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.575936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.602238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 790/1564] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/users => generated 281 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.603379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.615125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df236-979e-459f-987c-d9f5dee38a13 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.621294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:13.637662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310ea90-6928-47bc-b8e7-f792e38586d5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.642165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.642857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.643138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.643418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.644100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.646354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.660829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:13.674993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.676413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.676949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.677578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.678282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.678621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.682876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.692314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 791/1565] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.693093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.702426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44aa3-6165-4eb7-965c-677570b90cca admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.707499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.708194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.708476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.708864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.709548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.711433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.761890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 775/1566] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.762757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.812111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 792/1567] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.812966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.826975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b5f-f51f-4160-819a-20e67b6dd343 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.876181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798261-af8f-42a3-b0c3-7bd474dcfc9d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.881389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.882011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.882292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.882764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.883520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:13.883827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.885434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.885649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.886320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.886642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.886930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.887606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.889581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.907509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 793/1568] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:13.907509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:13.913301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e0282-34a7-445b-8ed4-8aa3a336e29a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:13.918111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:13.918805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:13.919849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:13.919849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:13.920356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:13.922296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:13.966520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 776/1569] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:13.967344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.009462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 794/1570] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.009462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.032472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa35a-0585-4301-8852-72d7a59330aa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.037930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:14.071151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc071-95ae-4133-9c25-9f8c5f3698ff admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.075841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.076508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.076852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.077198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.077887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.079507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.092414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 795/1571] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.092414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.093418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.094096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.094387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.094692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.095380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.097339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.101530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330609-b1c1-4fba-bc39-0b88a6e6cd6e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.106608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.107245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.107644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.107926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.108627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.110575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.208391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 777/1572] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:13 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.208391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.216326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a199e-4709-49a2-a348-22114acfc0a7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.221432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.222082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.222387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.222750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.223474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.225573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.230998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 796/1573] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.232197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.238647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:14.295650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690b81-e719-4263-902b-a9dcbc36fa00 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.300227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.301949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.302519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.302828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.303513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.305435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.319984 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 778/1574] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.325318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.330882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255342-9239-4b29-a019-2655c2c18d73 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.335418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.336045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.336327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.336602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.337305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.339250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.404651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 797/1575] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.412261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.415344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f786-ec18-4847-a9c0-717aeb9b5419 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.420092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.420771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.421072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.421452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.422127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.424069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.442045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 779/1576] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.442897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.496581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 798/1577] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.498100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.505048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ca253-8769-450c-8a2c-56569bbb1b09 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.508522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9050b1-5b46-42dc-b577-375e8f41be2a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.509910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.510645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.510934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.511216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.511986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.513102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.513753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.514039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.514317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.514497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.515063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.516725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.529002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 799/1578] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.529882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.539534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86b5e0-c316-47c6-b73c-cdd1dea8d71e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.544049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.549537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.549537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.549537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.549537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.549537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.557578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 800/1579] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.558200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.567932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efe2a-0745-4c07-935f-1f9e8ae3760d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.572661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.573318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.573601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.573874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.574668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.576518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.591089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 780/1580] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.591089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.599775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779c6d7-605a-4b68-ab22-6a43d6ddccd9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.604320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.604969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.607065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.607065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.607065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.607939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.618289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 781/1581] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.618995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.628231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959388b-95b1-402f-87d4-aa06263ed1f1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.633614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.634249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.634557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.634832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.635533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.637110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.648002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 801/1582] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.648002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.650382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 782/1583] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.650382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.656229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6d91-26e5-45b1-954d-f151670884bc admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.659427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102684-0303-4be7-a52a-879c92a7a7ae admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.660963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.661726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.662024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.662301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.663095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.664705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.665013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.665345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.665634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.665908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.666650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.668213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.679184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 783/1584] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.680035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.689474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fdf05-cde9-4a81-8d97-659ce7f43bfa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.694300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.695221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.695504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.695781 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] PATH_INFO: `/v3/projects/7c69cd491a97458e8dfe8c71ba4973bf/users/ca795a516f2a44bcb7db233735004570/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.707324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:14.710352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c69cd491a97458e8dfe8c71ba4973bf, user_id=ca795a516f2a44bcb7db233735004570, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.711424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:14.711424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:21:14.711424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:21:14.713385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.726443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 802/1585] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/users => generated 292 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:14.726443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.735862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2160d-2d6d-4673-a70f-c6021c72d4b4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.741208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.741879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.742145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.742459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.743185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.744765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.755063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 803/1586] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.755910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.765061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953025-dc36-4694-ba5a-ec0345a56dc7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.770986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 784/1587] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:14 2022] PUT /identity/v3/projects/7c69cd491a97458e8dfe8c71ba4973bf/users/ca795a516f2a44bcb7db233735004570/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:14.771842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.826943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.827611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.827900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.828171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.828897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.830525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.841043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 804/1588] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.841899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.843597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb3b8-02d4-402c-b305-84ddc8844da4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.846942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:14.849242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.850053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.850190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.850504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.851233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.852848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.852957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2587-39d5-407a-a6fd-dd6235d873e7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.857562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.860220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.860220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.860220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.860220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.861161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.866998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 785/1589] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.866998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.871492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 805/1590] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.872214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.874179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ead4-7cb8-4dbe-8432-8a317bd2d576 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.878894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.879542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.879857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.880139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.880860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.882315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d604-55a5-49ab-acfa-43dd227558b1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.882480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.886815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.888937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.888937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.888937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.888937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.890527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.895260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 786/1591] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.895738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.905072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 806/1592] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.905072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:14.906364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d38-8bbf-42ec-b912-84d3144d7e0a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.911272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.911950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.912237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.912516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.913270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.914923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bcc08-d0df-4198-8a07-253a60f4d10a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.915667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f26-6a6c-4389-931e-d260d9e869e7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:14.921360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:14.922242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.922711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.922992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] PATH_INFO: `/v3/projects/b192b5d371514aa2b2be06198a2bba19/users/96254efdc6c14e7e9ce7de7c09530312/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.926276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 787/1593] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:14.930435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:14.930743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:14.931029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:14.939118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b192b5d371514aa2b2be06198a2bba19, user_id=96254efdc6c14e7e9ce7de7c09530312, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:14.941817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:14.956258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] MFA Rules not processed for user `ca795a516f2a44bcb7db233735004570`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:14.960679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:15.011466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 807/1594] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:14 2022] PUT /identity/v3/projects/b192b5d371514aa2b2be06198a2bba19/users/96254efdc6c14e7e9ce7de7c09530312/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.012405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.028846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 788/1595] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:15.028846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.037401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3aa61-6409-44e2-a4ed-4054989c2a81 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.075055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b317dfd-68e8-4684-bda3-64bb2040b9fc admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.079704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.080377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.080669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.080949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.082194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.083952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.087056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:15.100100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 808/1596] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:15.100322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.100459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.100556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.100556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.100556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] PATH_INFO: `/v3/projects/f59b1e4812604590b2e1076de0ef992b/users/5b8d64ba9afb46498b7861e286da6d0e/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.105422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d812f8-c3ed-46f4-bc5d-cfaaa2d8826d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.111502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.112244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.112608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.112853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.113609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.113963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59b1e4812604590b2e1076de0ef992b, user_id=5b8d64ba9afb46498b7861e286da6d0e, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.115443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.116764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.125842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 809/1597] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:15.126711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.139932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146b041-8f4d-43c8-94e7-df660984e7a9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.140718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.141564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.141850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.142126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] PATH_INFO: `/v3/projects/2a8501dc7fb04de4ade7f25d979c11a0/users/61e6a4a2630443c0983b57e38470488f/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.157415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8501dc7fb04de4ade7f25d979c11a0, user_id=61e6a4a2630443c0983b57e38470488f, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.160249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.217084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 789/1598] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/f59b1e4812604590b2e1076de0ef992b/users/5b8d64ba9afb46498b7861e286da6d0e/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.217903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.245615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 810/1599] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/2a8501dc7fb04de4ade7f25d979c11a0/users/61e6a4a2630443c0983b57e38470488f/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.246819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.279677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa945-77cf-459d-b469-f1306f4bc934 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.318275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71546345-1347-4546-97a1-5ce3e8dd5c8e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.323078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.323742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.324030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.324307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.325034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.326881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27902a-db4a-49ab-9fb7-627ed2638b1f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.337045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.337213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 811/1600] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:15.338020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.338314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.338450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.338634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] PATH_INFO: `/v3/projects/cd963558c6d9429189f95901e1c5f37e/users/ba5568c014414787a4e29cb6aec70707/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.338722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.338977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.355107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd963558c6d9429189f95901e1c5f37e, user_id=ba5568c014414787a4e29cb6aec70707, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.355722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:15.356921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:15.357699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.364552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 812/1601] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:15.365332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.374564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba974-7eff-417c-9c9d-274051bde5eb None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.379636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.380277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.380564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.380959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.381671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.383588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.386849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:15.450416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 790/1602] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/cd963558c6d9429189f95901e1c5f37e/users/ba5568c014414787a4e29cb6aec70707/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.451295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.477245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 813/1603] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:15.478094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.518048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48682-f760-4104-b6da-71c589dfb217 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.529677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:15.540169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22630c-d3a3-4312-982c-4a7abaa57cb7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.544852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.545749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.546038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.546318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] PATH_INFO: `/v3/projects/479e5ffebb7e41ca99bb2752d13b2242/users/5391ed1b9b0b4a01bd2bc9351e2bd4e4/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.562096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479e5ffebb7e41ca99bb2752d13b2242, user_id=5391ed1b9b0b4a01bd2bc9351e2bd4e4, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.565352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ff10f-a342-461b-9252-dcbc09fdad15 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.576926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.577825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.578113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.578391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] PATH_INFO: `/v3/projects/ceb93886a41c40158377413fe1334483/users/3a18f608e0dd4f279f7d6f009927ff68/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.593126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb93886a41c40158377413fe1334483, user_id=3a18f608e0dd4f279f7d6f009927ff68, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.595859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aee8a-28ec-4da9-a746-82604548f559 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.673242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 814/1604] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/479e5ffebb7e41ca99bb2752d13b2242/users/5391ed1b9b0b4a01bd2bc9351e2bd4e4/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.674577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.674873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.675156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.685856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 791/1605] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/ceb93886a41c40158377413fe1334483/users/3a18f608e0dd4f279f7d6f009927ff68/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.687175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.687460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.688699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.705331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] MFA Rules not processed for user `5b8d64ba9afb46498b7861e286da6d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:15.706727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:15.715148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] MFA Rules not processed for user `61e6a4a2630443c0983b57e38470488f`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:15.716348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:15.772641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 815/1606] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:15.773559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.787240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 792/1607] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:15.788131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.847012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:15.851249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadac9e-c22c-4d48-93ef-bf364b519bd6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.852298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a86a9-3140-49de-b249-75165bb5dd24 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.855816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.855990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.856532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.856726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.856861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.857007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.857117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.857270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] PATH_INFO: `/v3/projects/86e7a17096764d97afa43985cea14bec/users/9845bb45f86e4e6ca2da841bfc0d0c60/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.867130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.868579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a77d-e07e-41e9-bfeb-4041c082a898 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.873212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7a17096764d97afa43985cea14bec, user_id=9845bb45f86e4e6ca2da841bfc0d0c60, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.875966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba605-7765-4dc6-97e6-d3dcaee23e64 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.878215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 793/1608] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:15.880181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.883569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.883569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.899119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:15.900815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:15.908697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 794/1609] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:15.909162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:15.919440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0272eed-72a9-4502-9b9a-f811c41f2fd4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:15.924131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:15.924821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.925105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.925519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.926217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:15.928460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590491-bf3c-44b9-9e4e-f507fc3264f5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:15.942840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 816/1610] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:15 2022] PUT /identity/v3/projects/86e7a17096764d97afa43985cea14bec/users/9845bb45f86e4e6ca2da841bfc0d0c60/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:15.944316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612d9b-3344-41f6-ab45-7d8b87fc3a0e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:15.946822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612d9b-3344-41f6-ab45-7d8b87fc3a0e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:15.946822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612d9b-3344-41f6-ab45-7d8b87fc3a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:15.962871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a3612d9b-3344-41f6-ab45-7d8b87fc3a0e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:15.966981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a3612d9b-3344-41f6-ab45-7d8b87fc3a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.005004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 795/1611] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:16.007142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295733-f7a0-4912-9b20-3dceb809577d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.007413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295733-f7a0-4912-9b20-3dceb809577d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.007690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295733-f7a0-4912-9b20-3dceb809577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.022955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.034506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 817/1612] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:16.036672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82e23-64ba-4710-8dd5-ce57d342eecd None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.037232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82e23-64ba-4710-8dd5-ce57d342eecd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.037232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82e23-64ba-4710-8dd5-ce57d342eecd None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.044602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 818/1613] 10.222.0.74 () {54 vars in 961 bytes} [Fri May 27 15:21:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:16.044602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5f7b-9492-4cf6-8489-a884a4e7a567 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.044822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5f7b-9492-4cf6-8489-a884a4e7a567 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.045097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5f7b-9492-4cf6-8489-a884a4e7a567 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.046744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 819/1614] 10.222.0.74 () {54 vars in 961 bytes} [Fri May 27 15:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:16.047417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5f7b-9492-4cf6-8489-a884a4e7a567 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.056875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-90295733-f7a0-4912-9b20-3dceb809577d None None] MFA Rules not processed for user `3a18f608e0dd4f279f7d6f009927ff68`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:16.058383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-90295733-f7a0-4912-9b20-3dceb809577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.106859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5f7b-9492-4cf6-8489-a884a4e7a567 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.110539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.111188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.111519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.112723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.124001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.125447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.125938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 796/1615] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:16.127304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ee46-7f15-4e37-958d-a7207edf6c96 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.130923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ee46-7f15-4e37-958d-a7207edf6c96 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.130923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ee46-7f15-4e37-958d-a7207edf6c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.139156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 820/1616] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:16.140097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.145534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7fe2ee46-7f15-4e37-958d-a7207edf6c96 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:16.146860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7fe2ee46-7f15-4e37-958d-a7207edf6c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.149801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9dd16-ddd4-4000-86df-f93da40b3b26 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.154472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.154996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 797/1617] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:16.155131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.155480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.155869 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.156735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.157594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.158107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.158260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.158363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.169865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 821/1618] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:16.170831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.172752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.181677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:16.182923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.187516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92dec-8609-41be-9fbb-67746aa33074 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.192941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.193738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.194077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.194519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.204775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.206386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9ca69-966e-4358-8132-89efc45a1dad service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.218380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 822/1619] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:16.224833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.225522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.226530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.251016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:16.252491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:16.258146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 798/1620] 10.222.0.74 () {58 vars in 1058 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:16.259269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.270442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2557ee-12c1-4be8-b5d8-eba45f85ac31 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.271675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 823/1621] 10.222.0.74 () {58 vars in 1058 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:16.272445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.280539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.281210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.281488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.281760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.282502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.284466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.290044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d658dc-7c87-458e-9558-3f400b8be0e2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.294351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.295652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.295945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.296228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] PATH_INFO: `/v3/projects/2160d4548a074fd2a6fb929ab22249c6/users/f6a96c2d19cc4e1aac1fb968cac450c2/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.314237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2160d4548a074fd2a6fb929ab22249c6, user_id=f6a96c2d19cc4e1aac1fb968cac450c2, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.315294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.373376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 799/1622] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:16.374524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.396582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 824/1623] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:16 2022] PUT /identity/v3/projects/2160d4548a074fd2a6fb929ab22249c6/users/f6a96c2d19cc4e1aac1fb968cac450c2/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:16.397802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.443358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.446949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796e133-319d-4ece-ad70-9cbf10c70675 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.469406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.485263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f05d-dbe0-4c5b-b3fa-3b0c624312b5 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.491516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.492173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.492457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.492733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.523907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.524662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.525018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.525703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.569851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.572145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.583589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 825/1624] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:16.599567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.621554 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75ba37-63f9-4ee9-9951-a157a72aba58 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.632183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.633972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.639324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.640113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.640460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.640793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.651297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 800/1625] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:16.652175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.664132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894e67-0e73-439e-9dc8-15c6367f2f53 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.670088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.670955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.672378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.672378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.672878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.675162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.736861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.740037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.762476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 826/1626] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:16.762476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.762802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 801/1627] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:16.763049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.766627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ac3a8-f4fc-42f4-a286-a1813c701db2 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.777952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dcfb-66c1-4c67-9548-4753223af58f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.783107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.784077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.784542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.785029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.785541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.786245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.787007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.791190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.791586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.791953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.792779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.794484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.805539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 827/1628] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:16.807107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.818800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dc45-7e6d-457e-bbe1-a63a6f987562 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.825537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 802/1629] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:16.837329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:16.851438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.853072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.855690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.856161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] PATH_INFO: `/v3/projects/2160d4548a074fd2a6fb929ab22249c6/users/f6a96c2d19cc4e1aac1fb968cac450c2/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.857977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d368b9-a593-4453-9abc-f56b9252e8e7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:16.861646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2160d4548a074fd2a6fb929ab22249c6, user_id=f6a96c2d19cc4e1aac1fb968cac450c2, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.869106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced83c62-fce4-4d6b-bae8-b3f5a87d7e92 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.876800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:16.876800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.876800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.876800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] PATH_INFO: `/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4/users/2a25fe04fa9f46af9166a274dbc98790/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.925295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1e19f544484e4d9ee62c55e2d56cc4, user_id=2a25fe04fa9f46af9166a274dbc98790, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:16.925295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36430f-676c-4f3c-88aa-a183aa851ffd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:16.926862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 828/1630] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:16 2022] PUT /identity/v3/projects/2160d4548a074fd2a6fb929ab22249c6/users/f6a96c2d19cc4e1aac1fb968cac450c2/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:16.928977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1d0b-6634-429c-961c-b9a474c55ab3 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.929436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1d0b-6634-429c-961c-b9a474c55ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.930989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1d0b-6634-429c-961c-b9a474c55ab3 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.932947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 829/1631] 10.222.0.74 () {54 vars in 912 bytes} [Fri May 27 15:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:16.934323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:16.934809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:16.935234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:16.968203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] MFA Rules not processed for user `f6a96c2d19cc4e1aac1fb968cac450c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:16.979564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:17.005936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:17.061763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 803/1632] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:16 2022] PUT /identity/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4/users/2a25fe04fa9f46af9166a274dbc98790/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:17.061763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.061763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.061763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.063190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 830/1633] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:17.064887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:17.106785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:17.108134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:17.148425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8e698-3e6d-4e67-953e-4023d3596c64 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:17.210205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 804/1634] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:17.211144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:17.223270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:17.240621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:17.241618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.242035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.242450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.243411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:17.245151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e828c-0380-4f76-80c9-ab169f91d627 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:17.266796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 831/1635] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:17.268334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f18d7-5302-474c-9587-f2e2ba001b74 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.268966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f18d7-5302-474c-9587-f2e2ba001b74 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.269100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f18d7-5302-474c-9587-f2e2ba001b74 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.271868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 832/1636] 10.222.0.74 () {54 vars in 912 bytes} [Fri May 27 15:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:17.272746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f18d7-5302-474c-9587-f2e2ba001b74 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:17.313214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73e944-3d19-4af4-8d14-db6c05470061 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:17.319343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:17.321729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.322184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.322643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.354139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f18d7-5302-474c-9587-f2e2ba001b74 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:17.359094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:17.360123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.360534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.361184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.376681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:17.379971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:17.398505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 833/1637] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:17.399495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:17.419397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696a2aa-b3b7-4d45-a7c8-242473b73dd6 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:17.441115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:17.441115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.441115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.441115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] PATH_INFO: `/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4/users/2a25fe04fa9f46af9166a274dbc98790/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.441552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1e19f544484e4d9ee62c55e2d56cc4, user_id=2a25fe04fa9f46af9166a274dbc98790, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:17.444762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763ec41-a9af-4884-a92a-38794222ddf3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:17.448181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:17.449879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f09ec-343a-42c2-8cc1-8bfb456a3c42 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:17.463753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 805/1638] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:17.465264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.465658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.466112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.474978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 834/1639] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:17 2022] PUT /identity/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4/users/2a25fe04fa9f46af9166a274dbc98790/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:17.487428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851975-7899-4231-a43c-f35bea468c51 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.488549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851975-7899-4231-a43c-f35bea468c51 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.488684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:17.488788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851975-7899-4231-a43c-f35bea468c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.489862 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:17.545897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fd851975-7899-4231-a43c-f35bea468c51 None None] MFA Rules not processed for user `2a25fe04fa9f46af9166a274dbc98790`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:17.548623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd851975-7899-4231-a43c-f35bea468c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:17.641573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 806/1640] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:17.661088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 835/1641] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:17.776411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:17.792738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:17.855839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa74c-4348-43de-bace-f8902eaf480c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:17.859733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:17.860530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:17.860852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:17.861202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:17.876062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:17.877526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7d2cd-4c7d-4bb5-99bc-48ba1d99533f service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:17.889811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 807/1642] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:18.036708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:18.037307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:18.037621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:18.085538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:18.102379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] MFA Rules not processed for user `96254efdc6c14e7e9ce7de7c09530312`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:18.104186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:18.231950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 836/1643] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:18.250090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:18.250090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:18.250090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:18.262506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] MFA Rules not processed for user `96254efdc6c14e7e9ce7de7c09530312`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:18.263752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:18.271959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 808/1644] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:18.531500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:18.548144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269af3-45db-404d-82cc-c0cf49d34672 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:18.555429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:18.556108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:18.556399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:18.556678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:18.569266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:18.570936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:18.585516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 837/1645] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:18.707136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:18.727778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b9552-ed5b-47cd-818b-ecc355412589 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:18.736031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:18.737326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:18.737834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:18.739046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:18.915627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:18.919888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:18.947178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 809/1646] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:19.512046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:19.512046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015702-eb0c-4ff1-bbbc-ee5d707d96a2 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:19.512046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:19.512046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:19.524127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:19.524127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:19.524127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:19.524127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f6c67-fbf1-4134-9b35-786a06a63432 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:19.524127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 838/1647] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:19.685282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:19.850480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a8c1-9d3d-453c-9197-0597cc81a41e service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:19.871131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:19.872155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:19.872537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:19.872892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] PATH_INFO: `/v3/users/3a18f608e0dd4f279f7d6f009927ff68` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:19.874506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a18f608e0dd4f279f7d6f009927ff68)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:19.877088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:19.877088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: warnings.warn(msg) May 27 15:21:19.877088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: May 27 15:21:19.884901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:20.215049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a18f608e0dd4f279f7d6f009927ff68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:20.216826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a18f608e0dd4f279f7d6f009927ff68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:20.232680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3562f3-70a1-43cd-8b05-e7599d0cd03e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:20.233089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3562f3-70a1-43cd-8b05-e7599d0cd03e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:20.233376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3562f3-70a1-43cd-8b05-e7599d0cd03e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:20.234831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 839/1648] 10.222.0.74 () {54 vars in 912 bytes} [Fri May 27 15:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:20.244137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:20.244631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:20.245213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:20.315547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:20.317065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:20.355630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:20.372802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a18f608e0dd4f279f7d6f009927ff68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:20.373873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a18f608e0dd4f279f7d6f009927ff68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:20.399735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 840/1649] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:20.446716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:20.448205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:20.464009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad8bd9-9ee0-4f99-9e0e-ae463a16c105 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:20.472021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:20.472798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:20.473086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:20.473362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:20.483724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:20.485414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a22e-089a-49bb-87c1-c2b4b3c9567b service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:20.513319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 841/1650] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:21:20.611212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a18f608e0dd4f279f7d6f009927ff68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:20.634885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:20.640962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 810/1651] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:19 2022] DELETE /identity/v3/users/3a18f608e0dd4f279f7d6f009927ff68 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:20.649686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:20.650080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:20.650366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:20.686535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:20.687795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:20.854280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 842/1652] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:20.860997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:20.864939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:21.026599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd651-2c23-4b53-8e54-874d5133024f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:21.032363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:21.038125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:21.038125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:21.038125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:21.045925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:21.048124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79e5ee-b1d7-489d-bba3-26c0bc96242a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:21.061410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 811/1653] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:22.140286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:22.143229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:22.157819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f706-6bdd-4d7f-a888-cd0e4cd20149 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.158336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f706-6bdd-4d7f-a888-cd0e4cd20149 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.158405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f706-6bdd-4d7f-a888-cd0e4cd20149 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.160891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 812/1654] 10.222.0.74 () {54 vars in 960 bytes} [Fri May 27 15:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:22.173400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.173715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.173996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.204817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1410aa5-cd9a-4100-9ab1-b5cf83b45963 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:22.220839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:22.224394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.224394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.224394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] PATH_INFO: `/v3/users/5b8d64ba9afb46498b7861e286da6d0e` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.224655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:22.227083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:22.228069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8d64ba9afb46498b7861e286da6d0e)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:22.230218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:22.481253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 813/1655] 10.222.0.74 () {58 vars in 1057 bytes} [Fri May 27 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:22.489636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:22.509929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68e3a-cf85-4cbb-a5df-ffe7f0a7ff60 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:22.523664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:22.524592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.525029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.525480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.527763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:22.544998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8d64ba9afb46498b7861e286da6d0e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:22.570051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:22.571795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:22.590163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 814/1656] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:22.632244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:22.638323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:22.673370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8d64ba9afb46498b7861e286da6d0e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:22.674126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8d64ba9afb46498b7861e286da6d0e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:22.716041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8d64ba9afb46498b7861e286da6d0e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:22.726021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122625b-e39e-4f2f-aa90-ed9cd0a26512 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:22.757072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:22.760062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.760583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.761222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] PATH_INFO: `/v3/projects/ceb93886a41c40158377413fe1334483` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.763130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2e2b05f1-7c04-4f1b-a144-4eaa1c4a1443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8d64ba9afb46498b7861e286da6d0e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:22.773428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb93886a41c40158377413fe1334483)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:22.780711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:22.789347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 843/1657] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:22 2022] DELETE /identity/v3/users/5b8d64ba9afb46498b7861e286da6d0e => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:22.809414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:22.809880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:22.810299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:22.836881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:22.839206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:22.987220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb93886a41c40158377413fe1334483', 'request_id': 'req-947438fe-58d7-42d1-b354-991bada383df'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.009678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb93886a41c40158377413fe1334483', 'request_id': 'req-947438fe-58d7-42d1-b354-991bada383df'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.020476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb93886a41c40158377413fe1334483', 'request_id': 'req-947438fe-58d7-42d1-b354-991bada383df'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.109911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:23.127022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] The token cache is being invalidate because project ceb93886a41c40158377413fe1334483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:23.129572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.129572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.131667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 815/1658] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:22 2022] DELETE /identity/v3/projects/ceb93886a41c40158377413fe1334483 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:23.135687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:23.140158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:23.150966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 844/1659] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:23.168062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:23.173665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:23.176933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:23.244466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7af07-3825-4f02-b2a4-367ab5a0d068 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:23.305037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:23.305881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:23.306248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:23.306803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:23.307774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947438fe-58d7-42d1-b354-991bada383df admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:23.319514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:23.321544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:23.321941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:23.323157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:23.323579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:23.324205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] PATH_INFO: `/v3/users/2a25fe04fa9f46af9166a274dbc98790` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:23.330919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a25fe04fa9f46af9166a274dbc98790)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:23.334252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:23.335331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 845/1660] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:23.605888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a25fe04fa9f46af9166a274dbc98790'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.608214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a25fe04fa9f46af9166a274dbc98790'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.726540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a25fe04fa9f46af9166a274dbc98790'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.727496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a25fe04fa9f46af9166a274dbc98790'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.767170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-147c72c9-a79b-4b1c-8de2-ad8e0decae72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a25fe04fa9f46af9166a274dbc98790'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:23.801288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 816/1661] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:23 2022] DELETE /identity/v3/users/2a25fe04fa9f46af9166a274dbc98790 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:24.565156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:24.567481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:24.592614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084a6f-3f72-478a-aba1-60940256b919 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:24.711340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:24.712648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:24.713135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:24.713630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] PATH_INFO: `/v3/projects/f59b1e4812604590b2e1076de0ef992b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:24.719795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59b1e4812604590b2e1076de0ef992b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:24.721056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: WARNING py.warnings [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 15:21:24.721056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: warnings.warn(msg) May 27 15:21:24.721056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: May 27 15:21:24.723191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:24.927427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59b1e4812604590b2e1076de0ef992b', 'request_id': 'req-96595eaa-8baf-462d-87e6-827befed76e6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:24.970630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59b1e4812604590b2e1076de0ef992b', 'request_id': 'req-96595eaa-8baf-462d-87e6-827befed76e6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:24.978403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59b1e4812604590b2e1076de0ef992b', 'request_id': 'req-96595eaa-8baf-462d-87e6-827befed76e6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:25.000881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] The token cache is being invalidate because project f59b1e4812604590b2e1076de0ef992b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:25.001624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:25.002560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-96595eaa-8baf-462d-87e6-827befed76e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:25.008930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 846/1662] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:24 2022] DELETE /identity/v3/projects/f59b1e4812604590b2e1076de0ef992b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:25.010818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.011262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.011382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.044857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:25.047463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:25.365095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.366444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.366978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.377271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 817/1663] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:25.410055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:25.413984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:25.455981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:25.456672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:25.468391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 847/1664] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:25.468485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b0e78-9a0d-4eb2-b9b0-e7acfc558d12 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:25.479516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:25.480351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.480738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.481212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.482051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:25.483331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:25.485193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:25.519649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:25.529145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 818/1665] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:25.533954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e688-f781-4a69-b7a9-ebccfda8ecb3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:25.545561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:25.547250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.547983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.548874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.553384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:25.558697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:25.695703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:25.705608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 848/1666] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:25 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:21:25.712327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82949a-eaaf-4941-84fd-d77c26b204f0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:25.744681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:25.845201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:25.848757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.849620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.849947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.851907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:25.860337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:25.903285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:25.908163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:25.932825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251f7b-0b2c-4e54-930a-9929e305f482 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:25.945566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:25.947134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:25.958265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:25.958614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] PATH_INFO: `/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:25.965230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1e19f544484e4d9ee62c55e2d56cc4)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:25.967223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.018949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 819/1667] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:25 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:26.024703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.055395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde081-dfbc-4260-a540-cb9a424ee974 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.072555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:26.074299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.084255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.088490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.089615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:26.092675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.139654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 820/1668] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:26.149748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.173137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7788f-123d-4a59-bcb4-3ae6a1545767 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.210790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1e19f544484e4d9ee62c55e2d56cc4', 'request_id': 'req-c63c4583-25ae-42df-a533-eba55a40b54c'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:26.319123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1e19f544484e4d9ee62c55e2d56cc4', 'request_id': 'req-c63c4583-25ae-42df-a533-eba55a40b54c'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:26.325739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1e19f544484e4d9ee62c55e2d56cc4', 'request_id': 'req-c63c4583-25ae-42df-a533-eba55a40b54c'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:26.347327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:26.348989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.350591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.350798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] The token cache is being invalidate because project cd1e19f544484e4d9ee62c55e2d56cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:26.350924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.351342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:26.351623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:26.353447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c63c4583-25ae-42df-a533-eba55a40b54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:26.355287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 849/1669] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:25 2022] DELETE /identity/v3/projects/cd1e19f544484e4d9ee62c55e2d56cc4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:26.358760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.360316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1f5d-1475-4e34-a6ef-cafc7eb32149 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.360757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1f5d-1475-4e34-a6ef-cafc7eb32149 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.361196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1f5d-1475-4e34-a6ef-cafc7eb32149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.378580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 821/1670] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:21:26.380787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.385379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:26.404253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-779b1f5d-1475-4e34-a6ef-cafc7eb32149 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:26.405868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-779b1f5d-1475-4e34-a6ef-cafc7eb32149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:26.409276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c82a9-4725-492a-883b-0043ce80ba15 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.417972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:26.420358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.421110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.422220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] PATH_INFO: `/v3/projects/693b9fddfcf34947adc36709169c7ce5/users/19bdb982594048ca8001d97c534a217d/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.424760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 850/1671] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:26.438834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.440611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.441670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.471614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:26.471614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:26.472132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693b9fddfcf34947adc36709169c7ce5, user_id=19bdb982594048ca8001d97c534a217d, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:26.475907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6871e6-a015-46c6-bdec-2baee113ad62 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.481378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 851/1672] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:26.486163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.518985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf2c5-5f96-49c7-89bd-63ffd7c5faac None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.528564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:26.529567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.530080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.530753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.532630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:26.533382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:26.536541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.554848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 852/1673] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:26.560062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.577270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34640e-fef2-40e6-b5a3-1df89b6f65d6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.594488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 822/1674] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:26 2022] PUT /identity/v3/projects/693b9fddfcf34947adc36709169c7ce5/users/19bdb982594048ca8001d97c534a217d/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:26.601284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.601653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.601838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.661638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] MFA Rules not processed for user `19bdb982594048ca8001d97c534a217d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:26.662178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:26.741225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:26.742967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:26.743362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:26.743751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:26.744572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:26.747955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:26.928689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 823/1675] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:26.929950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:26.931907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:26.956460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 853/1676] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:26 2022] POST /identity/v3/projects => generated 373 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:26.958030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604bf09-5982-4b2f-b9cc-b624ca38276e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:26.958762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:27.058733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:27.132561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:27.133616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.134004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.134613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] PATH_INFO: `/v3/users/61e6a4a2630443c0983b57e38470488f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.136166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e6a4a2630443c0983b57e38470488f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:27.146990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:27.200244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba0fe-2bab-43c5-8367-73e28cb3878f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:27.206261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:27.207955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.208247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.208505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.209323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:27.211372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:27.312132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 854/1677] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:26 2022] POST /identity/v3/projects => generated 375 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:27.317181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:27.416097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e6a4a2630443c0983b57e38470488f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:27.416831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e6a4a2630443c0983b57e38470488f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:27.502839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e6a4a2630443c0983b57e38470488f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:27.503519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e6a4a2630443c0983b57e38470488f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:27.534611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e6a4a2630443c0983b57e38470488f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:27.540711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f3af-77fb-440f-ba24-ef58e5120ca3 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:27.570562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:27.577301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.577301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.577301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.577301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:27.590292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3705d5-0262-41f8-a3bb-c30381ac3e18 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:27.611924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 824/1678] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:26 2022] DELETE /identity/v3/users/61e6a4a2630443c0983b57e38470488f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:27.611924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:27.611924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:27.746397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 855/1679] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:27 2022] POST /identity/v3/users => generated 287 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:27.748403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.749288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.751155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.818275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:27.828516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:27.865321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e0cd-fafb-49fd-955b-0d3c06022f59 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:27.884423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:27.885897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.886323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.886758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.887833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:27.912531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:27.953972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 856/1680] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:27.955216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:27.957068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:27.971320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb23255-57cd-414f-8224-f312e887ee11 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:27.977966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:27.979688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:27.980202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:27.984518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:27.984518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:27.984518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.001778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 857/1681] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:28.002831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.007347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:28.034026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 825/1682] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:27 2022] POST /identity/v3/users => generated 294 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:28.035757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.058292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53e47-7239-449e-bf6c-140d3f7b890e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.087507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.092921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.093393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.099070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.103263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.107219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.134613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 826/1683] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:28.138629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.157814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f4ac1-73da-4e6f-bb68-98943e06447e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.158966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ab01-f28f-4470-a09f-6c12dd693252 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.164759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.165770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.168297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.168297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.170449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.171362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.171743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.172116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.172940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.174775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.199744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 827/1684] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:28.227406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.238704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.238842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:28.245163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.263774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b341-ef4a-49e9-ac78-aa5c400d5b51 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.268617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 858/1685] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:28.270210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.278232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.279178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.279459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.282149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] PATH_INFO: `/v3/projects/e4e035386cd9434fb8718cd364ddfd80/users/2ff6cc385afd4c2ca01a261dcdbd5cd9/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.308478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090860f9-b869-4b52-91d1-902eb41d88ab service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.315331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e035386cd9434fb8718cd364ddfd80, user_id=2ff6cc385afd4c2ca01a261dcdbd5cd9, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.318263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976b3d0-be05-4bd6-a9a1-8edc8bd5b984 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.348692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.349216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.349500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.349832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] PATH_INFO: `/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2/users/2cac93076a9a4c0e99c1a7e51db0b700/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.382822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad86c154bafc4f4daff1b2a7fe590ba2, user_id=2cac93076a9a4c0e99c1a7e51db0b700, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.385826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.442819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 828/1686] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:28 2022] PUT /identity/v3/projects/e4e035386cd9434fb8718cd364ddfd80/users/2ff6cc385afd4c2ca01a261dcdbd5cd9/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:28.458314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.458633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.458914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.476056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 859/1687] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:28 2022] PUT /identity/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2/users/2cac93076a9a4c0e99c1a7e51db0b700/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:28.485199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.561904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] MFA Rules not processed for user `2ff6cc385afd4c2ca01a261dcdbd5cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:28.569136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:28.714964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4fa4-5c58-4b40-977b-d5b514450db3 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.725928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.726641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.726926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.727202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.734017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.737019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4fd53-14c1-461d-a636-6b4aec4bb388 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.773406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 860/1688] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:28.777569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c508b3-e40a-416a-815b-a9fb0938fbb6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.778304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c508b3-e40a-416a-815b-a9fb0938fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.779177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c508b3-e40a-416a-815b-a9fb0938fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.793845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 829/1689] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:28.795477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:28.826178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-31c508b3-e40a-416a-815b-a9fb0938fbb6 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:28.828948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12fa6f-17b4-4a9b-a45d-6212d6106e2b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:28.830297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-31c508b3-e40a-416a-815b-a9fb0938fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:28.839519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:28.840726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:28.842009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:28.843116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] PATH_INFO: `/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2/users/2cac93076a9a4c0e99c1a7e51db0b700/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:28.850666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad86c154bafc4f4daff1b2a7fe590ba2, user_id=2cac93076a9a4c0e99c1a7e51db0b700, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:28.856311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:28.883137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 830/1690] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:28 2022] PUT /identity/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2/users/2cac93076a9a4c0e99c1a7e51db0b700/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:28.888166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:29.018047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844a23-14d9-4b92-917a-fc0f4d7a0ec3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:29.026494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:29.027273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.027624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.028160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.030828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:29.033671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:29.058058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 861/1691] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:29.061122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded5a82-cd5b-4779-a849-8a36c794b78a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.061752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded5a82-cd5b-4779-a849-8a36c794b78a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.061940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded5a82-cd5b-4779-a849-8a36c794b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.105345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bded5a82-cd5b-4779-a849-8a36c794b78a None None] MFA Rules not processed for user `2cac93076a9a4c0e99c1a7e51db0b700`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:29.108876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bded5a82-cd5b-4779-a849-8a36c794b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:29.192404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 831/1692] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:28 2022] POST /identity/v3/projects => generated 373 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:29.197201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:29.339703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:29.361075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 862/1693] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:29.363431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.364189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.371485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.433433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] MFA Rules not processed for user `ba5568c014414787a4e29cb6aec70707`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:29.436444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:29.448199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b01e-2f9f-4d62-9bc1-0891e9cce11c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:29.459534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:29.460234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.460522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.460844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.461502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:29.463536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:29.480036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:29.619965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 832/1694] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:29 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:21:29.619965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:29.625532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:29.638512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 863/1695] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:29.639731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:29.642347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:29.666235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4375b-d095-423f-8ad6-2e635e09bb4e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:29.672351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:29.673601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.681406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.681914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] PATH_INFO: `/v3/projects/2a8501dc7fb04de4ade7f25d979c11a0` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.708222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8501dc7fb04de4ade7f25d979c11a0)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:29.709931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:29.856225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9e59c-3a39-4332-bf0d-23b02e8e07ce admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:29.861993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:29.862722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:29.863130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:29.863416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:29.865475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:29.936777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8501dc7fb04de4ade7f25d979c11a0', 'request_id': 'req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:30.034204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.036728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.049713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 833/1696] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:30.051560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:30.053014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8501dc7fb04de4ade7f25d979c11a0', 'request_id': 'req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:30.056400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:30.062540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8501dc7fb04de4ade7f25d979c11a0', 'request_id': 'req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:30.064488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132b2f-00d8-4feb-ab99-ce2396ad18b1 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:30.083955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] The token cache is being invalidate because project 2a8501dc7fb04de4ade7f25d979c11a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:30.084507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:30.085546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:30.091070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 864/1697] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:29 2022] DELETE /identity/v3/projects/2a8501dc7fb04de4ade7f25d979c11a0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:30.092371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:30.094190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.151982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:30.153110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.153455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.153786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.154558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.156220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.169547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 834/1698] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:30.170492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:30.176048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.292095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188bfd-fd8a-4582-b7ae-b99c8cc0dda8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:30.313406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:30.313964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.314575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.314884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.321497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.346712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf63dc-2127-474b-b7cd-7b37b1b438ef admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:30.360624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:30.361759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.370766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.371434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.373834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.465750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.467537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.476640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.478272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26a3fa-4bb6-40d9-927d-a364acc73e5c service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.484841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 835/1699] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:21:30.485734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:30.487299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.503027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 865/1700] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:30.504458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.504743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.505026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.511336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa810-4507-4cbd-9edd-a95678648b34 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:30.522656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:30.525100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.526134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.526562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] PATH_INFO: `/v3/users/ca795a516f2a44bcb7db233735004570` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.528261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca795a516f2a44bcb7db233735004570)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.531290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.556089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:30.557440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.586468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 866/1701] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:30.587676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:30.589441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:30.604951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fabb4-7420-4e11-967f-7e7d94924f00 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:30.611808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:30.613172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.613652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.614165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] PATH_INFO: `/v3/projects/1b0129ed0de34865a44b8ddd965e8562/users/4bc4bf068b0748a5b2eed8cbe994e007/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.647538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0129ed0de34865a44b8ddd965e8562, user_id=4bc4bf068b0748a5b2eed8cbe994e007, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:30.656287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec74ad2-eaa2-436a-a906-8dad6c4f3578 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:30.890477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 867/1702] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:30 2022] PUT /identity/v3/projects/1b0129ed0de34865a44b8ddd965e8562/users/4bc4bf068b0748a5b2eed8cbe994e007/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:30.895005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:30.895344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:30.895664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:30.978799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:30.980945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:31.032884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca795a516f2a44bcb7db233735004570'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:31.034323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca795a516f2a44bcb7db233735004570'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:31.167033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca795a516f2a44bcb7db233735004570'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:31.171271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca795a516f2a44bcb7db233735004570'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:31.191875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 868/1703] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:31.193267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:31.195004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:31.207705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca795a516f2a44bcb7db233735004570'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:31.233710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950a4f9-4722-4435-bf81-4e58cb2e5970 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:31.242085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 836/1704] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:30 2022] DELETE /identity/v3/users/ca795a516f2a44bcb7db233735004570 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:31.252674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:31.397058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:31.398491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.398838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.399276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.400113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:31.401793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf595-fe91-46ce-84f0-6402475d844e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:31.420963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0309e-2f8f-4bda-9fc9-8361f60164f6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:31.448515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 869/1705] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:31.448957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:31.449647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.449931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.451288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.452449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.452750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.455498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.455498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:31.455902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:31.462209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:31.507213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 837/1706] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:31.510668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:31.520762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:31.522559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:31.541740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917042-bfdf-4ee5-88a4-04c16717cc27 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:31.547043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 870/1707] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:31.547043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:31.557638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376da4f6-6558-44a0-869f-57abb7f86008 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:31.563330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:31.564064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.564458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.564750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.566264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:31.568211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:31.568374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402be8-2d9b-4a30-898d-6077b7c525f4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:31.570596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.572468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.575012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] PATH_INFO: `/v3/projects/1b0129ed0de34865a44b8ddd965e8562/users/4bc4bf068b0748a5b2eed8cbe994e007/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.583112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0129ed0de34865a44b8ddd965e8562, user_id=4bc4bf068b0748a5b2eed8cbe994e007, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:31.589640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:31.615602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 838/1708] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:31 2022] PUT /identity/v3/projects/1b0129ed0de34865a44b8ddd965e8562/users/4bc4bf068b0748a5b2eed8cbe994e007/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:31.639559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:31.649084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:31.714826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 871/1709] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:31 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:31.723459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8edf42-8f97-4479-b677-f695ffc5179f None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:31.727255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8edf42-8f97-4479-b677-f695ffc5179f None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:31.727698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8edf42-8f97-4479-b677-f695ffc5179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:31.915213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-de8edf42-8f97-4479-b677-f695ffc5179f None None] MFA Rules not processed for user `4bc4bf068b0748a5b2eed8cbe994e007`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:31.919167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-de8edf42-8f97-4479-b677-f695ffc5179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:31.927546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261422-5a30-462c-a25a-ad9b187473a3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.068399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:32.075386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.076076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.076528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.076818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.194591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 872/1710] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:32.199772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.200228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.200558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.278591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:32.282064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:32.312105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:32.314976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.317405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.320936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 873/1711] 10.222.0.77 () {58 vars in 1015 bytes} [Fri May 27 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:32.329730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.336977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 839/1712] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:32.351400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.353149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:32.369248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a45a9-32c6-47de-b61f-60d76e4d4e13 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.386421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.386421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.391145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.391463 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.395074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.397063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.551216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 874/1713] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:32 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:32.553522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.574308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237955d-101d-45ee-9e26-0f6539d621db admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.579722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.583565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.584271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.584807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.595428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba0f1-ab13-4de4-ba70-4ddf3bbc4c91 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.610112 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.616815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.621578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.622338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.629980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.632611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.638268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 875/1714] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:32.640967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.659094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bf7c-4df2-48eb-a759-25a7bf820c5f service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.667629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.673755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.676402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.676544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.676544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.676544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.676544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.681611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.710832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 840/1715] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:32.722960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 876/1716] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:32.725095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.761886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62bb53-6d3e-487c-9a34-55193bf1598a service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.788205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.789101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.789515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.789871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.790784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.792725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a191f40-019e-449c-954c-7bc7b01ac496 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.817611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 841/1717] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:32.829495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:32.835218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde155e-fd18-4d78-859b-c4a95d10221b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:32.853366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:32.854301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.854670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.860704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] PATH_INFO: `/v3/projects/1233efda95754c8bbb3f702e63f1abf6/users/5c27213929ae4ddfa78323774f565830/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:32.889997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1233efda95754c8bbb3f702e63f1abf6, user_id=5c27213929ae4ddfa78323774f565830, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:32.901495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:32.972412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 877/1718] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:32 2022] PUT /identity/v3/projects/1233efda95754c8bbb3f702e63f1abf6/users/5c27213929ae4ddfa78323774f565830/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:32.983416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:32.983691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:32.983978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:33.018856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:33.034713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] MFA Rules not processed for user `5c27213929ae4ddfa78323774f565830`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:33.037085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:33.070725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:33.155399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33c01-83dc-4cda-8dc6-4322dfbcca69 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:33.168628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:33.170035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:33.171692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:33.172774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:33.177374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:33.229683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 842/1719] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:33.231907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:33.236131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:33.376222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:33.379441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b0cc-e35e-43f4-ad12-6f59e7ca15df service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:33.414088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 878/1720] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:21:33.417695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97598f-aff9-4839-a8f9-7b39c5a52f56 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:33.418245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97598f-aff9-4839-a8f9-7b39c5a52f56 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:33.418384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97598f-aff9-4839-a8f9-7b39c5a52f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:33.429537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf74d3-5136-45a0-94da-be2099ebd4fd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:33.448523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:33.450278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:33.451198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:33.451536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:33.480708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:33.487945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:33.512046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-eb97598f-aff9-4839-a8f9-7b39c5a52f56 None None] MFA Rules not processed for user `9845bb45f86e4e6ca2da841bfc0d0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:33.513684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eb97598f-aff9-4839-a8f9-7b39c5a52f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:33.528695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 843/1721] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:33.727903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 879/1722] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:33.759907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:33.786827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c13c-f9f8-4403-b65f-8c3f0df3bdae service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:33.799351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:33.800061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:33.800433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:33.800952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:33.822765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:33.824438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:33.826316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:33.841130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 844/1723] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:34.142839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:34.380408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef96c-4a69-4196-8478-5161e39b9e73 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:34.380889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef96c-4a69-4196-8478-5161e39b9e73 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:34.380889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef96c-4a69-4196-8478-5161e39b9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:34.423901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:34.462876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fe9ef96c-4a69-4196-8478-5161e39b9e73 None None] MFA Rules not processed for user `5391ed1b9b0b4a01bd2bc9351e2bd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:34.464164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fe9ef96c-4a69-4196-8478-5161e39b9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:34.639698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 880/1724] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:34.654574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:34.656948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:34.661684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:34.669046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc187f-6886-4d86-8774-39a9c02d5e2a service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:34.685753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:34.689583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:34.694595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:34.694972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] PATH_INFO: `/v3/users/5c27213929ae4ddfa78323774f565830` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:34.699482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c27213929ae4ddfa78323774f565830)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:34.704375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:34.714097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] MFA Rules not processed for user `5391ed1b9b0b4a01bd2bc9351e2bd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:34.716221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:34.742629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 881/1725] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:34.746031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:34.748328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:34.772886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78018-7b57-4283-8a6a-65f5b7773882 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:34.797138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:34.799499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:34.800482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:34.801401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:34.822001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:34.828964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:34.880020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 882/1726] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:34.932830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:34.986596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c27213929ae4ddfa78323774f565830'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:34.987418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c27213929ae4ddfa78323774f565830'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.079660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c27213929ae4ddfa78323774f565830'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.080810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c27213929ae4ddfa78323774f565830'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.098470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:35.099938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:35.117435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b519bbb0-475e-4930-93e9-509d8d0f95b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c27213929ae4ddfa78323774f565830'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.131399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7110-dd76-44dd-a668-6cf6b76c7fc6 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:35.153481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:35.155661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:35.155951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:35.156231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] PATH_INFO: `/v3/projects/7c69cd491a97458e8dfe8c71ba4973bf` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:35.162025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c69cd491a97458e8dfe8c71ba4973bf)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:35.175983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:35.181677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 845/1727] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:34 2022] DELETE /identity/v3/users/5c27213929ae4ddfa78323774f565830 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:35.193884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:35.193884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:35.193884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:35.260172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:35.261482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:35.416700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c69cd491a97458e8dfe8c71ba4973bf', 'request_id': 'req-6aa56d7f-f61b-49e2-af44-d924a86ab33b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.428523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 846/1728] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:35.454826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:35.457999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:35.508480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c69cd491a97458e8dfe8c71ba4973bf', 'request_id': 'req-6aa56d7f-f61b-49e2-af44-d924a86ab33b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.516990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c69cd491a97458e8dfe8c71ba4973bf', 'request_id': 'req-6aa56d7f-f61b-49e2-af44-d924a86ab33b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.566787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] The token cache is being invalidate because project 7c69cd491a97458e8dfe8c71ba4973bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:35.567370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.569035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:35.574262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 883/1729] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:35 2022] DELETE /identity/v3/projects/7c69cd491a97458e8dfe8c71ba4973bf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:35.579054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:35.583917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:35.618449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aacad6-fe3f-444f-a3f8-0b79dcb3633c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:35.686479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:35.733454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56d7f-f61b-49e2-af44-d924a86ab33b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:35.770784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:35.770784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:35.770784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:35.770784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:35.771172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:35.771172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:35.771172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:35.771172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] PATH_INFO: `/v3/users/f6a96c2d19cc4e1aac1fb968cac450c2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:35.771448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a96c2d19cc4e1aac1fb968cac450c2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:35.771448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:35.771579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:35.808507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:35.821074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:35.854049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 847/1730] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:35.856727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:35.859395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:36.001535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a96c2d19cc4e1aac1fb968cac450c2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:36.044352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdc60-0222-44d0-9855-98625e2b0f15 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:36.049202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:36.050162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:36.050706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:36.050706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:36.054145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:36.079632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a96c2d19cc4e1aac1fb968cac450c2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:36.080334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a96c2d19cc4e1aac1fb968cac450c2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:36.098736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a96c2d19cc4e1aac1fb968cac450c2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:36.106203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:36.136020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-74925b88-f0c5-4d32-b45b-4842b8ce8f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a96c2d19cc4e1aac1fb968cac450c2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:36.158162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 884/1731] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:35 2022] DELETE /identity/v3/users/f6a96c2d19cc4e1aac1fb968cac450c2 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:36.207793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:36.209420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d18ef-180c-484c-8831-751d9c10c4b5 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:36.228025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 848/1732] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:36.546746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b3f8-befc-4bf5-848b-55c2aeacfe43 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:36.548425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b3f8-befc-4bf5-848b-55c2aeacfe43 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:36.549229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b3f8-befc-4bf5-848b-55c2aeacfe43 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:36.552483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 885/1733] 10.222.0.74 () {54 vars in 912 bytes} [Fri May 27 15:21:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:21:36.566959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413d263-2701-41a0-bf48-ee3b0f7cb264 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:36.568970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413d263-2701-41a0-bf48-ee3b0f7cb264 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:36.568970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413d263-2701-41a0-bf48-ee3b0f7cb264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:36.637470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1413d263-2701-41a0-bf48-ee3b0f7cb264 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:36.650033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1413d263-2701-41a0-bf48-ee3b0f7cb264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:36.916648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 849/1734] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:21:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:37.013159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:37.014597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:37.015072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:37.016664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 886/1735] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:21:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:37.089227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:37.089754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:37.089754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:37.147697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:37.172584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:37.177781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:37.204956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:37.205471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:37.210714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8c44c-150a-4f43-8054-5dd606a361ee None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:37.229897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:37.231922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:37.237400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:37.237400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:37.272914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:37.276547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9bd68-67f2-48da-8cf7-9929d72b7d4d service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:37.326701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 887/1736] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:37.425245 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 850/1737] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:37.663016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:37.924528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:37.924928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:37.925277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:37.982810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] MFA Rules not processed for user `ba5568c014414787a4e29cb6aec70707`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:37.985558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:38.051879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:38.203442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 888/1738] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:38.529632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:38.529632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:38.558309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:38.560871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:38.616926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73981ae-c9d9-4a29-986c-fb8dc898a88c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:38.648392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:38.654559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:38.654917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:38.655198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:38.696569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:38.704273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa360afb-0246-4af8-ae73-37d1908c039a service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:38.748307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 851/1739] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:38.879637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcb94b-de3b-41cc-a10a-fa34db7a5c0d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:38.897821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:38.899046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:38.899486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:38.899936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] PATH_INFO: `/v3/projects/2160d4548a074fd2a6fb929ab22249c6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:38.901419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2160d4548a074fd2a6fb929ab22249c6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:38.911444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:39.169563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2160d4548a074fd2a6fb929ab22249c6', 'request_id': 'req-98aa3dce-7931-414c-a930-90841a675bd1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.240317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2160d4548a074fd2a6fb929ab22249c6', 'request_id': 'req-98aa3dce-7931-414c-a930-90841a675bd1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.247051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2160d4548a074fd2a6fb929ab22249c6', 'request_id': 'req-98aa3dce-7931-414c-a930-90841a675bd1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.283232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] The token cache is being invalidate because project 2160d4548a074fd2a6fb929ab22249c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:39.294640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.294640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-98aa3dce-7931-414c-a930-90841a675bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.295692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 889/1740] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:38 2022] DELETE /identity/v3/projects/2160d4548a074fd2a6fb929ab22249c6 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:39.302536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:39.303240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:39.303675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:39.345611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:39.348346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:39.586193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:39.586755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 852/1741] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:39.591714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:39.591714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:39.634364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:39.636202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:39.664050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:39.666093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:39.674685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638071-24a2-44fb-af5c-f0b1cba24413 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:39.698234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:39.699417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:39.704025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:39.704571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] PATH_INFO: `/v3/projects/1233efda95754c8bbb3f702e63f1abf6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:39.711222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1233efda95754c8bbb3f702e63f1abf6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:39.716032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:39.724566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 890/1742] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:39.726827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:39.764253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59cc97-e1d8-443b-94b8-be82c82d5921 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:39.780890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:39.781813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:39.782302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:39.782779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:39.783834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:39.784365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:39.787064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:39.805940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 891/1743] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:39.812887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:39.840965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25b21-e896-4e92-b55b-7e4bedcc2354 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:39.866364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:39.868226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:39.872475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:39.872982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:39.884293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:39.890309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:39.975684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1233efda95754c8bbb3f702e63f1abf6', 'request_id': 'req-7bcec0b7-484a-4823-b991-ad368a4cda00'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:39.997281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1233efda95754c8bbb3f702e63f1abf6', 'request_id': 'req-7bcec0b7-484a-4823-b991-ad368a4cda00'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:40.011645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1233efda95754c8bbb3f702e63f1abf6', 'request_id': 'req-7bcec0b7-484a-4823-b991-ad368a4cda00'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:40.036634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 892/1744] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:39 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:40.040967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.104871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] The token cache is being invalidate because project 1233efda95754c8bbb3f702e63f1abf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:40.105320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:40.106140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7bcec0b7-484a-4823-b991-ad368a4cda00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:40.114001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 853/1745] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:39 2022] DELETE /identity/v3/projects/1233efda95754c8bbb3f702e63f1abf6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:40.119762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08262a0-8e1c-4255-8268-59926317b68f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.119762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08262a0-8e1c-4255-8268-59926317b68f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.119762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08262a0-8e1c-4255-8268-59926317b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.148376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:40.196989 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e08262a0-8e1c-4255-8268-59926317b68f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:40.200563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e08262a0-8e1c-4255-8268-59926317b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:40.264016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adedb8-dbef-4539-a35d-1e2538d2e8ad admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.271997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:40.278065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.283679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.283679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.283679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.283679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.283679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.409116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 854/1746] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:40.416940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.417227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.417513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.464531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 893/1747] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/users => generated 282 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:21:40.471447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.480787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:40.523750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:40.525010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:40.561647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e39a0-0389-451e-87dd-4585d9917630 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.574967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 855/1748] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:40.578535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.582980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.587842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.589523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.593838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.597191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.599071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.610845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727bca-daee-4ebe-b1ab-212688493430 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.648167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.651232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 894/1749] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:40.655295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.671428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.672772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.673231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.675502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:40.680623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.685928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336174-f1d6-4970-89f6-735d30a144bc admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.687638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.720607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.720607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.721088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.722348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.725111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.729769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.733029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 856/1750] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:40.737722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.780953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 895/1751] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:40.784840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9059-6b65-4d33-9ff4-3ab321652bd4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.786492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:40.817761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.819818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40fd5-68e8-462a-91dd-c40aa1eddc4a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:40.824315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.824623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.824912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.835590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.839663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.850665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:40.854537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:40.856388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.860033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.860628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] PATH_INFO: `/v3/projects/6734b22b70ea4ac2bc58065b5ead7a46/users/4958267d9c6e433da8a07fe548d0c7a3/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.911053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6734b22b70ea4ac2bc58065b5ead7a46, user_id=4958267d9c6e433da8a07fe548d0c7a3, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:40.918064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c99dfa-3f44-48b6-b48e-814cefc72c09 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:40.982943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 896/1752] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:40 2022] PUT /identity/v3/projects/6734b22b70ea4ac2bc58065b5ead7a46/users/4958267d9c6e433da8a07fe548d0c7a3/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:40.985286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:40.988786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:40.989320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:40.997824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 857/1753] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/projects => generated 401 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:41.000537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.141106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] MFA Rules not processed for user `4958267d9c6e433da8a07fe548d0c7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:41.145835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:41.147568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c69ca9-e381-473f-8aca-31035c0e8ca2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:41.171128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:41.173141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.174074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.179107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.179107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:41.197827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8421e7-d1fa-4f33-b077-bd3757ad23f7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:41.352477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 858/1754] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/users => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:41.356954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.357494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.357949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.362030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 897/1755] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:41.363969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.411082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] MFA Rules not processed for user `5391ed1b9b0b4a01bd2bc9351e2bd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:41.414693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:41.468010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32e79-8e6d-4b48-a017-4644b5ae0023 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:41.494760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:41.500248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.500248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.500248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.506296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:41.508094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:41.566458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 898/1756] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:41.567999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.605644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eed3-c45e-4862-8722-b4676a2682a1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:41.610910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 859/1757] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:41.611962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.641391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:41.648015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.648406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.648700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.651707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:41.653755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:41.656421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63056-2bfe-4348-84c4-ba1032ab6544 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:41.676896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:41.677605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.678162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.678547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.679287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:41.682108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:41.711884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 860/1758] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:41.717276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.772016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2720-cb04-4a43-9b82-031286ca9018 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:41.792710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:41.794518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.794996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.795590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] PATH_INFO: `/v3/projects/8829130bea234b978524f869039f7b78/users/40b4df2f45ec48c4a9f2209b9279de6a/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.805517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:41.836275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8829130bea234b978524f869039f7b78, user_id=40b4df2f45ec48c4a9f2209b9279de6a, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:41.840055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4a08e-6494-4852-a5cf-73245c40a104 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:41.866831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 899/1759] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:41 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:41.876545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:41.949596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:41.959521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 861/1760] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:41 2022] PUT /identity/v3/projects/8829130bea234b978524f869039f7b78/users/40b4df2f45ec48c4a9f2209b9279de6a/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:41.965783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:41.966357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:41.967282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:41.972843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace1d9-0b05-4007-951d-23aff4fe1840 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.040488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.041753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.042048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.042347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.043108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.045433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.068907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:42.072755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:42.095142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 862/1761] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:42.130364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 900/1762] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:41 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:42.131616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:42.146669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8f084-b4a5-44f9-8037-8615fd803165 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.149829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:42.152124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:42.160681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.161473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.161863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.163790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.163790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.168914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.195651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 863/1763] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:42.196794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:42.219397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a71d1-5eb0-4ae5-82a0-27daa5413e77 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.236917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.238353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.238788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.239176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] PATH_INFO: `/v3/projects/9cc66d828bd34bab9a87bd78f3434b13/users/19ca5421a58a4578b76d4a56a1a89ecb/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.275453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc66d828bd34bab9a87bd78f3434b13, user_id=19ca5421a58a4578b76d4a56a1a89ecb, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.278808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.342000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a22596-76b9-4666-b9a3-7547f92cf2de admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.364309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.365670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.365670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.368842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.385075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 864/1764] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:42 2022] PUT /identity/v3/projects/9cc66d828bd34bab9a87bd78f3434b13/users/19ca5421a58a4578b76d4a56a1a89ecb/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:42.389233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:42.424632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.440676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.508659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 901/1765] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:21:42.651650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc807c-d0d5-4c1f-9a10-05869dcef0c9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.668801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.671971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.674167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.691069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.691868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.695596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee1ba-536f-45f9-9408-3aee570c0ccc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.737077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 865/1766] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:21:42.741479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:42.753408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e300-6d57-48fa-ac38-0e36b19b5338 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:42.775404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:42.776574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.778212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.778741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] PATH_INFO: `/v3/projects/9cc66d828bd34bab9a87bd78f3434b13/users/19ca5421a58a4578b76d4a56a1a89ecb/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.781049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc66d828bd34bab9a87bd78f3434b13, user_id=19ca5421a58a4578b76d4a56a1a89ecb, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:42.793254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:42.809801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 902/1767] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:42 2022] PUT /identity/v3/projects/9cc66d828bd34bab9a87bd78f3434b13/users/19ca5421a58a4578b76d4a56a1a89ecb/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:42.828023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bc41-e9ee-4c04-9d24-b58bb5e27417 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:42.828324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bc41-e9ee-4c04-9d24-b58bb5e27417 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:42.829212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bc41-e9ee-4c04-9d24-b58bb5e27417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:42.923581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d551bc41-e9ee-4c04-9d24-b58bb5e27417 None None] MFA Rules not processed for user `19ca5421a58a4578b76d4a56a1a89ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:42.929591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d551bc41-e9ee-4c04-9d24-b58bb5e27417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:43.155259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:43.156078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 866/1768] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:43.158263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:43.436268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fe8f-c151-42c2-90db-a9ea28a2ba36 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:43.462622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:43.469324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:43.470279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:43.471357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:43.477085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:43.521059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:43.523073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:43.550985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 903/1769] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:43.715703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:43.845906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95454fe-4047-48e4-90cf-bc8ba118aed2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:43.846195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95454fe-4047-48e4-90cf-bc8ba118aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:43.846599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95454fe-4047-48e4-90cf-bc8ba118aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:43.892184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d95454fe-4047-48e4-90cf-bc8ba118aed2 None None] MFA Rules not processed for user `9845bb45f86e4e6ca2da841bfc0d0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:43.903824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d95454fe-4047-48e4-90cf-bc8ba118aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:43.954671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:43.971404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac152921-ba78-47ec-a8f1-0162ad498a6d service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:43.988998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:43.989640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:43.994688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:43.994688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:44.178246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:44.187441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 867/1770] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:44.215676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:44.277322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 904/1771] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:47.574166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:47.574839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:47.574956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:47.699983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] MFA Rules not processed for user `40b4df2f45ec48c4a9f2209b9279de6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:47.704504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:47.895569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 868/1772] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:47.901498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:47.998609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:48.011511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10f3f4-2027-44db-a857-98a192b6289d service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.019532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.021726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.022244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.022905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.024137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.030093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.187619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 905/1773] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:47 2022] POST /identity/v3/projects => generated 405 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:48.189118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:48.201253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b79ab-1bfd-42b1-844d-100e5f283254 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.266002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.266749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.267037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.267312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.268026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.270839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.280733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:48.363640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 869/1774] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:48 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:48.365082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:48.375734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57ec99-0a87-4ff1-b162-adecd6a6eb16 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.381278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.382182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.382514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.382797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.383529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.385142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.398149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 906/1775] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:48.402259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:48.423588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a1f0-68ee-4c94-b03f-483b1321df1a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.434205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.435182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.435469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.435753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] PATH_INFO: `/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c/users/82217322590046da92918ea05f412afe/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.460526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b915d6b3ef7439bbec9a25bccc8ad5c, user_id=82217322590046da92918ea05f412afe, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.463291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.543428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 870/1776] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:48 2022] PUT /identity/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c/users/82217322590046da92918ea05f412afe/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:48.547516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:48.562739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4edb8-5fdc-43ab-9803-675cc7f58442 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.630998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.631725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.632014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.632328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.633007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.634825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.649008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 907/1777] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:48.652980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:48.675248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea3b84-17e6-4f16-ba39-0498687e8301 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:48.692652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:48.694838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:48.695327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:48.695759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] PATH_INFO: `/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c/users/82217322590046da92918ea05f412afe/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:48.699332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b915d6b3ef7439bbec9a25bccc8ad5c, user_id=82217322590046da92918ea05f412afe, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:48.703174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea337c9c-1043-4fe4-a16c-990965ac6a0e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:48.718607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 871/1778] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:48 2022] PUT /identity/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c/users/82217322590046da92918ea05f412afe/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:49.781509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:49.793180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085f9-7060-4660-901e-b13a4b921aff admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:49.880832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:49.883243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:49.884364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:49.884954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] PATH_INFO: `/v3/users/4958267d9c6e433da8a07fe548d0c7a3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:49.886712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4958267d9c6e433da8a07fe548d0c7a3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:49.889180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:50.120412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4958267d9c6e433da8a07fe548d0c7a3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:50.250512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4958267d9c6e433da8a07fe548d0c7a3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:50.251154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4958267d9c6e433da8a07fe548d0c7a3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:50.261114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4958267d9c6e433da8a07fe548d0c7a3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:50.270453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:50.282059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4958267d9c6e433da8a07fe548d0c7a3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:50.292754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 908/1779] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:49 2022] DELETE /identity/v3/users/4958267d9c6e433da8a07fe548d0c7a3 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:50.294918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0641f-6c38-4c10-853b-8937ce6cf404 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:50.295396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0641f-6c38-4c10-853b-8937ce6cf404 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:50.295639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0641f-6c38-4c10-853b-8937ce6cf404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:50.337038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d5e0641f-6c38-4c10-853b-8937ce6cf404 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:50.339393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d5e0641f-6c38-4c10-853b-8937ce6cf404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:50.429427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 872/1780] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:50.451397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:50.452964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:50.545577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff3ea4-b807-4bf6-8851-e17d3d672371 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:50.550799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:50.551629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:50.552026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:50.552392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:50.566218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:50.567984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aa12a-3c20-4a33-ae64-e32b5603990d service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:50.579090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 909/1781] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:51.690050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875319-d781-46b7-830f-c8d092fc07fe None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:51.690625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875319-d781-46b7-830f-c8d092fc07fe None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:51.690798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875319-d781-46b7-830f-c8d092fc07fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:51.746122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d2875319-d781-46b7-830f-c8d092fc07fe None None] MFA Rules not processed for user `82217322590046da92918ea05f412afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:51.748476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d2875319-d781-46b7-830f-c8d092fc07fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:51.926608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:51.926608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:51.926608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:51.926608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 910/1782] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:51.931626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 873/1783] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:51.953179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:51.955626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:51.977817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:51.978525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:51.979022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:51.998045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589dd6-c5f0-40ec-a49a-5a24f762a402 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:52.009067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:52.088840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:52.088840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:52.088840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:52.088840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] PATH_INFO: `/v3/projects/6734b22b70ea4ac2bc58065b5ead7a46` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:52.090399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:52.090870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6734b22b70ea4ac2bc58065b5ead7a46)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:52.090870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:52.153280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:52.190156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 874/1784] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:52.515969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:52.515969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:52.538507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80972c-286b-4a03-87b9-a1f6604011b1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:52.556103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:52.556922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:52.557308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:52.557689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:52.569673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:52.571452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:52.587480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 875/1785] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:52.882129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6734b22b70ea4ac2bc58065b5ead7a46', 'request_id': 'req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:52.972510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6734b22b70ea4ac2bc58065b5ead7a46', 'request_id': 'req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:52.995600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6734b22b70ea4ac2bc58065b5ead7a46', 'request_id': 'req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.011881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] The token cache is being invalidate because project 6734b22b70ea4ac2bc58065b5ead7a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:53.012250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.012946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-14c86c2c-0ec9-431e-8235-b819b4bcc6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.014689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 911/1786] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:51 2022] DELETE /identity/v3/projects/6734b22b70ea4ac2bc58065b5ead7a46 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:53.018675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:53.036771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb218e-bef0-48e5-b41a-86fd75f050b4 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:53.100708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:53.101640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:53.101928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:53.102210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] PATH_INFO: `/v3/users/19ca5421a58a4578b76d4a56a1a89ecb` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:53.103491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ca5421a58a4578b76d4a56a1a89ecb)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:53.108946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:53.324494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ca5421a58a4578b76d4a56a1a89ecb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.325211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ca5421a58a4578b76d4a56a1a89ecb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.433070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ca5421a58a4578b76d4a56a1a89ecb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.433723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ca5421a58a4578b76d4a56a1a89ecb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.457187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40c7fda0-19c5-4c8d-b394-6ac957eb1269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ca5421a58a4578b76d4a56a1a89ecb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:53.491507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 876/1787] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:53 2022] DELETE /identity/v3/users/19ca5421a58a4578b76d4a56a1a89ecb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:53.881253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:53.881553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:53.881837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:53.883378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 912/1788] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:53.930835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401554-740a-4d23-9fdd-fc02ec46a0b6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:53.931135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401554-740a-4d23-9fdd-fc02ec46a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:53.931422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401554-740a-4d23-9fdd-fc02ec46a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:53.953551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-90401554-740a-4d23-9fdd-fc02ec46a0b6 None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:53.954837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-90401554-740a-4d23-9fdd-fc02ec46a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:53.997213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:54.022910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 877/1789] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:54.059382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:54.061846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:54.079154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545a37-ec50-476a-bef3-9f8d2ed4f11e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:54.085001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:54.086233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:54.086233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:54.086546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:54.097282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:54.098771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d18e5-397e-4d3d-a5ca-211c5eda1dc1 service placement] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:54.110740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 913/1790] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:54.416276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:54.416846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:54.417274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:54.421489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 878/1791] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:21:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:54.429846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:54.430151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:54.430460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:54.453040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:54.454752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:54.522207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:54.544230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 914/1792] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:54.591587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:54.593886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:54.631921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fbd92-1270-49e6-8298-9b63289adbdb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:54.642721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:54.643425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:54.643886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:54.644306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:54.659103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:54.672205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4921af-8f67-45b4-8a3d-9b6cc11c9b05 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:54.688316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 879/1793] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:54.853073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:54.855022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.080445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824903-b7b2-4da8-ad4d-42de3a9c1804 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.085932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.086953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.087349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.087844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] PATH_INFO: `/v3/projects/9cc66d828bd34bab9a87bd78f3434b13` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.090126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc66d828bd34bab9a87bd78f3434b13)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.092660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:55.273959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc66d828bd34bab9a87bd78f3434b13', 'request_id': 'req-7710d83f-f4c0-49e6-806a-7a0710d7a632'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:55.292533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ec92d-f050-4853-af40-6b16542dd667 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.293000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ec92d-f050-4853-af40-6b16542dd667 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.293230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ec92d-f050-4853-af40-6b16542dd667 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.294737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 880/1794] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:21:55.308171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ae54-262c-40f7-88c9-9f696cd8fc4e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.308679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ae54-262c-40f7-88c9-9f696cd8fc4e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.309110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ae54-262c-40f7-88c9-9f696cd8fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.340118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cbb3ae54-262c-40f7-88c9-9f696cd8fc4e None None] MFA Rules not processed for user `ea4efcee73dd41089b084d21f5cd5005`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:55.341647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cbb3ae54-262c-40f7-88c9-9f696cd8fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.348103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc66d828bd34bab9a87bd78f3434b13', 'request_id': 'req-7710d83f-f4c0-49e6-806a-7a0710d7a632'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:55.356390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc66d828bd34bab9a87bd78f3434b13', 'request_id': 'req-7710d83f-f4c0-49e6-806a-7a0710d7a632'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:55.376888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] The token cache is being invalidate because project 9cc66d828bd34bab9a87bd78f3434b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:55.377199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:55.381175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7710d83f-f4c0-49e6-806a-7a0710d7a632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:55.385769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 915/1795] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:54 2022] DELETE /identity/v3/projects/9cc66d828bd34bab9a87bd78f3434b13 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:55.391749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.406078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.406687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.444538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:55.447240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.473623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 881/1796] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:55.554528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 916/1797] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:55.562207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.562541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.562864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.584520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:55.586027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.601135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:55.602504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 882/1798] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:55.613509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed3a8-366d-4ba4-939c-4714610bb81e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.619397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.620134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.620567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.620921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.621735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:55.622060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.623898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:55.651912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 917/1799] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:21:55.656232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:55.679235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:55.679393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae475e-e8d9-4255-8821-7fa6b8007a67 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.681466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.701403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.701403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.701403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.701403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.701706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.706146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:55.706277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684cc72-65d2-41fb-94e9-da868513c460 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.712575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.714767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.714767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.714767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.741661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:55.745368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.751134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:55.780072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 918/1800] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:21:55.781203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:55.785254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:55.822876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 883/1801] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:55 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:55.828266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412b08c-0c10-4aa8-b70f-1d282e109b1e service placement] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.829451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:55.925979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.928388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.929246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.929751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] PATH_INFO: `/v3/users/40b4df2f45ec48c4a9f2209b9279de6a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.932482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b4df2f45ec48c4a9f2209b9279de6a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.936480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:55.966121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded92f-3499-49ab-ab04-18e0d4db2802 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:55.975932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:55.977177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:55.979378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:55.979378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:55.979378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:55.982883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.091466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 884/1802] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:55 2022] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:56.092668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.119333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616134-f86e-4852-8d4a-601c3017d11c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.134710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.136260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.137166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.137510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.138316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.140629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.166676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b4df2f45ec48c4a9f2209b9279de6a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.182379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 885/1803] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:56.185331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.199224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf62c2-1ad6-4127-8933-59a00fe4926f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.206356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.207178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.207642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.208023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.208937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.210767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.219251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:56.240785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 886/1804] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:21:56.248393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.261678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b4df2f45ec48c4a9f2209b9279de6a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.262299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b4df2f45ec48c4a9f2209b9279de6a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.272567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b4df2f45ec48c4a9f2209b9279de6a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.274603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311e3d-a393-4ef6-90d6-013da7464c88 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.282870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.284495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.284495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.284739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] PATH_INFO: `/v3/projects/7e501ed9a8f04928a914e004994fde97/users/f0782f59853241bc9bedabdf7ddf7650/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.316603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b4df2f45ec48c4a9f2209b9279de6a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.329415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e501ed9a8f04928a914e004994fde97, user_id=f0782f59853241bc9bedabdf7ddf7650, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.343049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 919/1805] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:55 2022] DELETE /identity/v3/users/40b4df2f45ec48c4a9f2209b9279de6a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:56.343202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f50e11-ed5e-4bc3-8ee7-3dc9433893c9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.375860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.379448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:56.440671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 887/1806] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:56 2022] PUT /identity/v3/projects/7e501ed9a8f04928a914e004994fde97/users/f0782f59853241bc9bedabdf7ddf7650/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:56.450946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.451699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.452045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.480555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6314548-abde-45d3-9149-ece7628e4ecb admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.486297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] MFA Rules not processed for user `f0782f59853241bc9bedabdf7ddf7650`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:56.488714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:56.578072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.579582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.580069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.581052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] PATH_INFO: `/v3/users/19bdb982594048ca8001d97c534a217d` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.582592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bdb982594048ca8001d97c534a217d)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.585497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.610168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 888/1807] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:56.614581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.616940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:56.632565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80fde-f1bc-48f5-8f65-d6290808d7cf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.640243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.640525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.641312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.641644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.642358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.645255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.776268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 889/1808] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:56 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:56.777637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:56.809453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bdb982594048ca8001d97c534a217d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.860909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88336-89dd-45eb-b1ad-17499b5d0438 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:56.865928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:56.866737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:56.867169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:56.867512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:56.868583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:56.872649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:56.933045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bdb982594048ca8001d97c534a217d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.935683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bdb982594048ca8001d97c534a217d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.959009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bdb982594048ca8001d97c534a217d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:56.998656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-35ba6b4d-9d3d-4c84-b67d-e93d69fcb297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bdb982594048ca8001d97c534a217d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.010089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 920/1809] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:56 2022] DELETE /identity/v3/users/19bdb982594048ca8001d97c534a217d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:57.017227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.017227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.017227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.019346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 890/1810] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:56 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:21:57.023500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.026640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.049107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf9ad-21ef-4032-b383-592b042e4294 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.050670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:57.052216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.180710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.181726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.181975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 921/1811] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:57.182456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.182614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.186066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.188389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.196154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.197733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.205109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 891/1812] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:21:57.209673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.225107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a94f-0099-40c7-a65c-73954e111347 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.232374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.233847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.234443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.235039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] PATH_INFO: `/v3/projects/5de3229c3b724460a82d7fffa67944e0/users/34d2cc93b4b14b8f8de22d53941ee4d2/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.258719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de3229c3b724460a82d7fffa67944e0, user_id=34d2cc93b4b14b8f8de22d53941ee4d2, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.262927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.272209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d90ce-91f2-4441-9229-583b7a4f5dac None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.275959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.276792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.277245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.277408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.288077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.289698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.300422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 922/1813] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:21:57.301251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.302908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.317517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af678-99bc-480a-ade8-4954073e8788 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.333221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.333653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.333998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.334286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] PATH_INFO: `/v3/projects/8829130bea234b978524f869039f7b78` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.335683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8829130bea234b978524f869039f7b78)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.338603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.350352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 892/1814] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:57 2022] PUT /identity/v3/projects/5de3229c3b724460a82d7fffa67944e0/users/34d2cc93b4b14b8f8de22d53941ee4d2/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:57.354293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.435170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdb69-d4fa-416d-a147-c8491511f445 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.440023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.440712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.440995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.441840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.441986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.443818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.454399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 893/1815] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:21:57.458767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.469012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e3091-d7ce-4be3-9e70-6d7c0883b97b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.474434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.475325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.475640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.475919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] PATH_INFO: `/v3/projects/5de3229c3b724460a82d7fffa67944e0/users/34d2cc93b4b14b8f8de22d53941ee4d2/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.478029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de3229c3b724460a82d7fffa67944e0, user_id=34d2cc93b4b14b8f8de22d53941ee4d2, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.480715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5df3-dcaf-4c54-9eb9-451f449cb1d2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.493660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 894/1816] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:21:57 2022] PUT /identity/v3/projects/5de3229c3b724460a82d7fffa67944e0/users/34d2cc93b4b14b8f8de22d53941ee4d2/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:21:57.504526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.504822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.505165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.545087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8829130bea234b978524f869039f7b78', 'request_id': 'req-b8174d65-11b5-4386-8973-a06d34baca92'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.554031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] MFA Rules not processed for user `34d2cc93b4b14b8f8de22d53941ee4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:57.555670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.610570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8829130bea234b978524f869039f7b78', 'request_id': 'req-b8174d65-11b5-4386-8973-a06d34baca92'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.617578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8829130bea234b978524f869039f7b78', 'request_id': 'req-b8174d65-11b5-4386-8973-a06d34baca92'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.641234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] The token cache is being invalidate because project 8829130bea234b978524f869039f7b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:57.641551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.642604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:57.647203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 923/1817] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:57 2022] DELETE /identity/v3/projects/8829130bea234b978524f869039f7b78 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:57.652962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.659430 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.722077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 895/1818] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:57.733176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:57.735662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:57.765268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:57.813935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8174d65-11b5-4386-8973-a06d34baca92 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.824017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.825501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.826915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.826915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] PATH_INFO: `/v3/users/82217322590046da92918ea05f412afe` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.828047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=82217322590046da92918ea05f412afe)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.830691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.838950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02c9a-fbe3-4e1d-8028-b52b41a1756c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:57.843677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:57.844564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:57.844853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:57.845127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:57.876868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:57.879267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:57.893106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 896/1819] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:21:58.051459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82217322590046da92918ea05f412afe'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.131068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82217322590046da92918ea05f412afe'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.131729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82217322590046da92918ea05f412afe'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.141555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82217322590046da92918ea05f412afe'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.169932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:58.171803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:58.194816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82217322590046da92918ea05f412afe'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.202529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 924/1820] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:57 2022] DELETE /identity/v3/users/82217322590046da92918ea05f412afe => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:58.222833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a7-1f9f-490e-977c-addc62366175 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:58.364115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:58.480281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:58.482224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:58.484696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:58.484995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] PATH_INFO: `/v3/projects/693b9fddfcf34947adc36709169c7ce5` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:58.490953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693b9fddfcf34947adc36709169c7ce5)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:58.497637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:58.682356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693b9fddfcf34947adc36709169c7ce5', 'request_id': 'req-3776ad50-de66-41e8-ad7f-3ccfe47884d4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.689354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693b9fddfcf34947adc36709169c7ce5', 'request_id': 'req-3776ad50-de66-41e8-ad7f-3ccfe47884d4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.703253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693b9fddfcf34947adc36709169c7ce5', 'request_id': 'req-3776ad50-de66-41e8-ad7f-3ccfe47884d4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.811175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] The token cache is being invalidate because project 693b9fddfcf34947adc36709169c7ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:58.811175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.811973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:58.813827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 897/1821] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:58 2022] DELETE /identity/v3/projects/693b9fddfcf34947adc36709169c7ce5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:58.818815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:58.821223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:58.837730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d024-f882-4826-999b-4a93f5d54fad admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:58.900521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:58.904832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:58.918726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:58.921836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:58.922128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:58.922440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] PATH_INFO: `/v3/users/2cac93076a9a4c0e99c1a7e51db0b700` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:58.924351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ad50-de66-41e8-ad7f-3ccfe47884d4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:58.928318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cac93076a9a4c0e99c1a7e51db0b700)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:58.929419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:58.960243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:58.961273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:58.961874 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:58.962353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] PATH_INFO: `/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:58.964949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b915d6b3ef7439bbec9a25bccc8ad5c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:58.969889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.202077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cac93076a9a4c0e99c1a7e51db0b700'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.209340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b915d6b3ef7439bbec9a25bccc8ad5c', 'request_id': 'req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.215327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b915d6b3ef7439bbec9a25bccc8ad5c', 'request_id': 'req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.224001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b915d6b3ef7439bbec9a25bccc8ad5c', 'request_id': 'req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.272563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cac93076a9a4c0e99c1a7e51db0b700'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.273575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cac93076a9a4c0e99c1a7e51db0b700'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.284850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cac93076a9a4c0e99c1a7e51db0b700'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.298975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2aa0124a-8b46-4122-a74c-38c030d6b16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cac93076a9a4c0e99c1a7e51db0b700'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.309332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 925/1822] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:21:58 2022] DELETE /identity/v3/users/2cac93076a9a4c0e99c1a7e51db0b700 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:59.369006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] The token cache is being invalidate because project 0b915d6b3ef7439bbec9a25bccc8ad5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:21:59.369539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.373981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:21:59.373981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 898/1823] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:58 2022] DELETE /identity/v3/projects/0b915d6b3ef7439bbec9a25bccc8ad5c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:21:59.377839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1a3e-5db0-49c0-ad4b-6d8d80fdccec None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.378136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1a3e-5db0-49c0-ad4b-6d8d80fdccec None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.378469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1a3e-5db0-49c0-ad4b-6d8d80fdccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.398080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-378b1a3e-5db0-49c0-ad4b-6d8d80fdccec None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:59.399404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-378b1a3e-5db0-49c0-ad4b-6d8d80fdccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:59.467796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 926/1824] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:21:59.467942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.467942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:59.469926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.470223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.470546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.490116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:21:59.491432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:59.499321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 927/1825] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:21:59.503950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.514016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751228d1-59c7-4080-b8ce-73a58420b51a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.520725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.523214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.523491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.523773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.524691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:59.525009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.526662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.541395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c4ed-c70c-41c7-8ea7-1adb3f1bce18 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.542136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 928/1826] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:21:59.546569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.558278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120f67-b920-4378-a661-4a79bda47073 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.563533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.564322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.565068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.565361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.566357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.568602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.614662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34d2cc93b4b14b8f8de22d53941ee4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5de3229c3b724460a82d7fffa67944e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.615342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.615628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.615906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.616633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:59.616944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.619455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.639677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 899/1827] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:59.644483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.657103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f1e3-af59-46fe-b0c2-dd8ae62a3c5f tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.662712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34d2cc93b4b14b8f8de22d53941ee4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5de3229c3b724460a82d7fffa67944e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.663208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.663493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.663778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.664464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.666484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.669203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 929/1828] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:59 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:59.673663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.741459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf3fa0-63d0-4184-b089-8c8e038b201e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.747152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.747904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.748328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.748673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.752767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.754069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.786766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 900/1829] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:21:59 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:21:59.787881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.896865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 930/1830] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:21:59 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:21:59.896865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.901832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:21:59.908685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bfb-b61f-4ba9-b301-217921526676 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:21:59.909104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34d2cc93b4b14b8f8de22d53941ee4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5de3229c3b724460a82d7fffa67944e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:21:59.911718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:21:59.912057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:21:59.912346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:21:59.913252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:21:59.913597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:21:59.915317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:21:59.930345 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 901/1831] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:21:59.931478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:21:59.946556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401209-f753-4cee-a955-c3fd6b369cee admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.025988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ced7e-2ec9-4b3c-83c3-36aad3d65731 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.031467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.032079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.032373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.032655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.033946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.035759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.040321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.041202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.045718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.045718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] PATH_INFO: `/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.045718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad86c154bafc4f4daff1b2a7fe590ba2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.045718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.048644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 902/1832] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:00.050352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.062134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de84a-1c7a-4839-a088-9e492b8afb81 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.067284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34d2cc93b4b14b8f8de22d53941ee4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5de3229c3b724460a82d7fffa67944e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.068156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.068446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.068727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] PATH_INFO: `/v3/projects/91108038c01d4fa1a673ab609b371955` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.069959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91108038c01d4fa1a673ab609b371955)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.073422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.137766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad86c154bafc4f4daff1b2a7fe590ba2', 'request_id': 'req-3dae68cb-2334-4f99-8ee8-7c234f2ab234'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.188463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91108038c01d4fa1a673ab609b371955', 'request_id': 'req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.194721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91108038c01d4fa1a673ab609b371955', 'request_id': 'req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.198364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad86c154bafc4f4daff1b2a7fe590ba2', 'request_id': 'req-3dae68cb-2334-4f99-8ee8-7c234f2ab234'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.207359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91108038c01d4fa1a673ab609b371955', 'request_id': 'req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.208200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad86c154bafc4f4daff1b2a7fe590ba2', 'request_id': 'req-3dae68cb-2334-4f99-8ee8-7c234f2ab234'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.223971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] The token cache is being invalidate because project ad86c154bafc4f4daff1b2a7fe590ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:00.224206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.225113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.227082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 931/1833] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:21:59 2022] DELETE /identity/v3/projects/ad86c154bafc4f4daff1b2a7fe590ba2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:00.227572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.229045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:00.292370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] The token cache is being invalidate because project 91108038c01d4fa1a673ab609b371955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:00.292780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.294082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1c84e365-ecc9-4eb0-b7fa-0a8d378af229 tempest-VolumeQuotaClassesTest-1756162030 tempest-VolumeQuotaClassesTest-1756162030-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:00.309927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 903/1834] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:00 2022] DELETE /identity/v3/projects/91108038c01d4fa1a673ab609b371955 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:00.313064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471a8e-b8ad-4d49-a68e-0299f547980e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.315473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471a8e-b8ad-4d49-a68e-0299f547980e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.315902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471a8e-b8ad-4d49-a68e-0299f547980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.349536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae68cb-2334-4f99-8ee8-7c234f2ab234 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.357365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-11471a8e-b8ad-4d49-a68e-0299f547980e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:00.358462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-11471a8e-b8ad-4d49-a68e-0299f547980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:00.451399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 904/1835] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:00.452065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.452628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.452628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.452914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.453986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.457226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.461535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.468692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.469007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.472492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 932/1836] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:00.475973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.478462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:00.489833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:00.491114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:00.495160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f3b0-04c0-4726-b450-42ec50df8a3e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.505473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.508525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.508525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.508525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] PATH_INFO: `/v3/projects/8d6c771ca26e4198857b3fdbce7add70/users/7e7f8e73ac554d8e982a6b7b3cfdfa15/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.513264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 905/1837] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:00.527222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.538591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0e73-9190-4806-978e-7ce634500234 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.544378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6c771ca26e4198857b3fdbce7add70, user_id=7e7f8e73ac554d8e982a6b7b3cfdfa15, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.545415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.546106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.546393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.546787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.547687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:00.547867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233db60-c490-44c4-a834-6bb4691f65a0 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.548010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.550188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.572621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 906/1838] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:00.593600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.605726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710f403-7738-46de-a25d-e97044403e0f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.620817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.621507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.622272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.622609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.623307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.625295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.673348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 933/1839] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:00 2022] PUT /identity/v3/projects/8d6c771ca26e4198857b3fdbce7add70/users/7e7f8e73ac554d8e982a6b7b3cfdfa15/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:00.686808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.687153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.687435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.715220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] MFA Rules not processed for user `7e7f8e73ac554d8e982a6b7b3cfdfa15`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:00.716751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:00.763992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 907/1840] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:00.765855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.790461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 934/1841] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:00.791237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.819873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:00.844053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9feddf-5a07-4e98-a6ef-9208d5bde299 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.850127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.850881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.851163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.851451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.856426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.856426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.865961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24ca61-2eb9-46dc-8efe-109c21bae6cc None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:00.873265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:00.874147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:00.874551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:00.874834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:00.875596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:00.879908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:00.977130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 908/1842] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:00.978140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 935/1843] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:00.982195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.983433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:00.992263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f9bb-cc3a-4381-94c5-3bd9712a5332 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.062040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b372-32b2-4c3b-93b0-4110f3f91acb admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.074064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.075663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.076127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.076582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.080859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.081065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.081597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.082328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.082664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.082952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.083707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.085673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.098951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 909/1844] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:01.098951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.098951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.114522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1e13-b126-48d2-832a-41744a652b81 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.119552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.120504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.120794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.121068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] PATH_INFO: `/v3/users/f0782f59853241bc9bedabdf7ddf7650` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.122256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0782f59853241bc9bedabdf7ddf7650)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.124207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.154467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 936/1845] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:00 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:01.155211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.167867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418778-4c30-4d9d-ae3d-8e0947df98f9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.173527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.175233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.175520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.176077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.176543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.178394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.188875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 937/1846] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:01.189740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.196909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:01.202632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219902-f9f8-4bbe-b189-7ce2a9301759 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.207633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.208327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.209257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.209686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.210718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.212422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.225159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 938/1847] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:01.225992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.235597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad6b5-820d-4659-bc14-977ce312c1d6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.243567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.244501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.244789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.245071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] PATH_INFO: `/v3/projects/d352af915216487c99169c8b436fdec7/users/0ec00310986d460489a23df7a95c62dc/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.263156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d352af915216487c99169c8b436fdec7, user_id=0ec00310986d460489a23df7a95c62dc, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.265998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.350013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0782f59853241bc9bedabdf7ddf7650'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:01.350709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0782f59853241bc9bedabdf7ddf7650'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:01.401042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 939/1848] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:01 2022] PUT /identity/v3/projects/d352af915216487c99169c8b436fdec7/users/0ec00310986d460489a23df7a95c62dc/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:01.402054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.410262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0782f59853241bc9bedabdf7ddf7650'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:01.411446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0782f59853241bc9bedabdf7ddf7650'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:01.428413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c2b46adf-6828-4a9b-b241-a1b4d5503c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0782f59853241bc9bedabdf7ddf7650'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:01.441748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 910/1849] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:01 2022] DELETE /identity/v3/users/f0782f59853241bc9bedabdf7ddf7650 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:01.444279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6bb5-90c0-4e85-ad31-fd50514d180e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.446172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6bb5-90c0-4e85-ad31-fd50514d180e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.446172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6bb5-90c0-4e85-ad31-fd50514d180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.472620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8cb72-156a-46da-872d-2feb2356f8e9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.473002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b65d6bb5-90c0-4e85-ad31-fd50514d180e None None] MFA Rules not processed for user `0ec00310986d460489a23df7a95c62dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:01.474368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b65d6bb5-90c0-4e85-ad31-fd50514d180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.531793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.532610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.532901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.533185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] PATH_INFO: `/v3/projects/4f51606c08bd49f294fd25bdcc3f5290/users/5b6f0f2bef7941ec8f8120893f7f92f1/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.539668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 911/1850] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:01.541166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.541496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.541779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.549409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f51606c08bd49f294fd25bdcc3f5290, user_id=5b6f0f2bef7941ec8f8120893f7f92f1, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.551948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.560372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:01.561600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.569996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 912/1851] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:01.570865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.572111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.583778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4cb57-11fe-44fd-9401-6327f6343886 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.588803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.589484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.591297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.591297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.591297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.592652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.617231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 940/1852] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:01 2022] PUT /identity/v3/projects/4f51606c08bd49f294fd25bdcc3f5290/users/5b6f0f2bef7941ec8f8120893f7f92f1/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:01.618053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.619738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.675402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 913/1853] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:01 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:01.677477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.679438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.686445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454bf4-bcf0-413d-87c6-2fc02759748a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.746995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.747750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.748241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.748626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.756702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf80b-af25-432a-b43b-d46b93cf6522 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.761937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.762672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.763437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.763906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.764134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.764575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.765559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.778682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 941/1854] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:01.779067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.779753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.798554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 914/1855] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:01.799336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05564-559c-46e2-a550-5b16a626d5dd service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.799336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.799336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.799336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.799676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.800380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.801975 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.802892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.827765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5455c-bb8a-4b1d-82e8-2584fed0e99b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:01.847176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:01.848907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.849541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.852672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] PATH_INFO: `/v3/projects/4f51606c08bd49f294fd25bdcc3f5290/users/5b6f0f2bef7941ec8f8120893f7f92f1/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.852943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f51606c08bd49f294fd25bdcc3f5290, user_id=5b6f0f2bef7941ec8f8120893f7f92f1, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:01.856439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa2a66-ba79-4e28-ba70-b6a3379c0daa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:01.880566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 915/1856] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:01 2022] PUT /identity/v3/projects/4f51606c08bd49f294fd25bdcc3f5290/users/5b6f0f2bef7941ec8f8120893f7f92f1/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:01.882277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:01.882658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:01.883046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:01.918333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] MFA Rules not processed for user `5b6f0f2bef7941ec8f8120893f7f92f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:01.919776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:01.926872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 942/1857] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:01 2022] POST /identity/v3/users => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:01.931026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:01.950840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329b97-0af1-48c1-955e-3c18189ba914 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.034042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 916/1858] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:02.046854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.049336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.062582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.066523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.066523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.066523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.066523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.069833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.084376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 943/1859] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:02.101464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.152584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a2b-74f6-4c4b-aabf-e95f8c2a86cb admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.187482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b9f3-449d-485e-a23e-9030d1d75fd1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.192634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.193313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.193602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.193882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.195624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.198257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.204240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.204690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] PATH_INFO: `/v3/projects/66c28033ea8f4d688989b79cb3bf2938/users/448ad4339b074436b57476a7e85bad0c/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.221709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.223583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.240645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 917/1860] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:02.263434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c28033ea8f4d688989b79cb3bf2938, user_id=448ad4339b074436b57476a7e85bad0c, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.266246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.416209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 944/1861] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:02 2022] PUT /identity/v3/projects/66c28033ea8f4d688989b79cb3bf2938/users/448ad4339b074436b57476a7e85bad0c/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:02.420656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.434109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0795-d6ac-4a6e-a8d0-0e639a62a46f service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.475392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:02.494108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.494832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.495123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.495404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.496141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.497790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.512205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 918/1862] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:02.515743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.518466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.519471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.531346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd5e2e-8949-4c80-9413-712247341677 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.537556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.538996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.539461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.540051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] PATH_INFO: `/v3/projects/66c28033ea8f4d688989b79cb3bf2938/users/448ad4339b074436b57476a7e85bad0c/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.541986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c28033ea8f4d688989b79cb3bf2938, user_id=448ad4339b074436b57476a7e85bad0c, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.545102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7d00-f927-4c10-91d1-74aeb6e580f1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.558893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 919/1863] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:02 2022] PUT /identity/v3/projects/66c28033ea8f4d688989b79cb3bf2938/users/448ad4339b074436b57476a7e85bad0c/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:02.560562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8547-5945-411d-a870-f2435a478597 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.577509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.578037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.578766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.612553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] MFA Rules not processed for user `448ad4339b074436b57476a7e85bad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:02.613792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.632770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.633676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.633962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.634289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] PATH_INFO: `/v3/projects/7e501ed9a8f04928a914e004994fde97` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.635538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e501ed9a8f04928a914e004994fde97)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:02.637484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:02.690461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 920/1864] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:02.769081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e501ed9a8f04928a914e004994fde97', 'request_id': 'req-d7dd9cb4-78f8-4254-a982-337cc9c398ca'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:02.807108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.808767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.843887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e501ed9a8f04928a914e004994fde97', 'request_id': 'req-d7dd9cb4-78f8-4254-a982-337cc9c398ca'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:02.855858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e501ed9a8f04928a914e004994fde97', 'request_id': 'req-d7dd9cb4-78f8-4254-a982-337cc9c398ca'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:02.864641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] The token cache is being invalidate because project 7e501ed9a8f04928a914e004994fde97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:02.866918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:02.867812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:02.870089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 945/1865] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:02 2022] DELETE /identity/v3/projects/7e501ed9a8f04928a914e004994fde97 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:02.874292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:02.876046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.886985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27766-85c0-4802-b0a3-3eb3e6cf6bea None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:02.985710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:02.986481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:02.986774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:02.987049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:02.990852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:02.992654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9cb4-78f8-4254-a982-337cc9c398ca admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:03.002466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:03.003536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:03.005068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:03.005068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] PATH_INFO: `/v3/users/34d2cc93b4b14b8f8de22d53941ee4d2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:03.006096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d2cc93b4b14b8f8de22d53941ee4d2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:03.008594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:03.071644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:03.073779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:03.087654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 921/1866] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:03.219390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d2cc93b4b14b8f8de22d53941ee4d2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:03.221163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:03.222918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:03.233447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aede94-1aa4-46d2-9e99-a22907267c7f service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:03.237924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:03.238611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:03.243276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:03.243276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:03.243276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:03.301275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d2cc93b4b14b8f8de22d53941ee4d2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:03.301978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d2cc93b4b14b8f8de22d53941ee4d2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:03.305413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:03.306961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:03.310139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d2cc93b4b14b8f8de22d53941ee4d2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:03.317832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 922/1867] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:03.325212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d2cc93b4b14b8f8de22d53941ee4d2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:03.331148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 946/1868] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:02 2022] DELETE /identity/v3/users/34d2cc93b4b14b8f8de22d53941ee4d2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:03.449992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:03.460109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfbb6-15fc-40ff-9e10-7352de3530fe service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:03.519425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:03.520142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:03.520480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:03.521125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:03.523072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:03.584878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:03.586336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db19dd-911d-46f6-b064-35c9105a1dd7 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:03.598400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 923/1869] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:03.825343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:03.825343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:03.893865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ee55-75a0-4216-9092-6ab7ad14566b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:03.898683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:03.899555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:03.899931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:03.900213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] PATH_INFO: `/v3/projects/5de3229c3b724460a82d7fffa67944e0` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:03.901422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de3229c3b724460a82d7fffa67944e0)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:03.903423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:03.958335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:04.031531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de3229c3b724460a82d7fffa67944e0', 'request_id': 'req-cf30d753-bbba-4f42-9058-653372e6c2f5'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:04.129605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de3229c3b724460a82d7fffa67944e0', 'request_id': 'req-cf30d753-bbba-4f42-9058-653372e6c2f5'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:04.135801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de3229c3b724460a82d7fffa67944e0', 'request_id': 'req-cf30d753-bbba-4f42-9058-653372e6c2f5'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:04.149159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] The token cache is being invalidate because project 5de3229c3b724460a82d7fffa67944e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:04.149458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:04.150191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cf30d753-bbba-4f42-9058-653372e6c2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:04.152288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 947/1870] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:03 2022] DELETE /identity/v3/projects/5de3229c3b724460a82d7fffa67944e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:04.157152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.157452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.166334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.180578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:04.181617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:04.265038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 924/1871] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:04.273303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.273597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.273881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.326298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:04.327569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:04.344367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 948/1872] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:04.349114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.368949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390620-219d-4b5f-83c5-ce64be8c77d8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.375865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.376725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.377484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.377590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.378626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:04.379099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.381088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:04.398544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 925/1873] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:04.401705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.414254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7bed6-0a5b-4400-9f08-e63f0b8fc0a9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.421551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.424838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.424838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.424838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.425585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.436497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:04.570119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 949/1874] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:04.582995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.594766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a16f-bc82-40bd-a660-ef64bba7162c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.679128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.682165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.682489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.682815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.684105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.686377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:04.813336 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 926/1875] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:04 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:04.818262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.828865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5f95-338b-47b3-b471-0da00d8b3eb0 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.833294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.833953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.834236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.834543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.835267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.836878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:04.848834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 950/1876] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:04.853640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.864185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e46453-3552-432c-85b8-d67f58a87a80 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.868727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.869387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.869724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.869942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.876755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.876755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bcce2-d158-4b07-a1f1-c75b734b2568 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:04.882265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 927/1877] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:04.886514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:04.896899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b0b0d-a516-4778-a2c3-59fcf706db34 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:04.905731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:04.905731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:04.905731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:04.905731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] PATH_INFO: `/v3/projects/f439715e56a24fa1841df05f6cb045f7/users/002bc19390f843aa9b4b9535806c0766/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:04.920301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f439715e56a24fa1841df05f6cb045f7, user_id=002bc19390f843aa9b4b9535806c0766, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:04.923087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.015235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 951/1878] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:04 2022] PUT /identity/v3/projects/f439715e56a24fa1841df05f6cb045f7/users/002bc19390f843aa9b4b9535806c0766/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:05.028419 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.028719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.029002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.058195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] MFA Rules not processed for user `002bc19390f843aa9b4b9535806c0766`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:05.059465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:05.123000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 928/1879] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:05.128619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.191474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3dba0-6a4a-4c24-bc45-7603177bcea3 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.196105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.196763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.197044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.197320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.198018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.199948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.215556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:05.316780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 952/1880] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:05 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:05.320832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.335150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb173958-636f-44f3-85d7-85ac286fc7c9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.416100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.416998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.417420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.418096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.419115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.421409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.542870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 929/1881] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:05 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:05.547210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.567613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195259-4edd-45ed-b0c7-dd618b87184a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.579761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.582172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.582513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.582789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.584295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.589048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.612391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 953/1882] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:05.619576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.636682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fad291-42c7-4580-ba3c-edfe2c693a91 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.648452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.649400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.649690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.649969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] PATH_INFO: `/v3/projects/97fdac284efd41ba938aa8b9155e7b80/users/32ea833f94a046c3a27245552d36acea/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.668518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fdac284efd41ba938aa8b9155e7b80, user_id=32ea833f94a046c3a27245552d36acea, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.671645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.806692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 930/1883] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:05 2022] PUT /identity/v3/projects/97fdac284efd41ba938aa8b9155e7b80/users/32ea833f94a046c3a27245552d36acea/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:05.812285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.826142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498ed6-b3d7-4026-b581-35153e4190b8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.891288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.892405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.893557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.893996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.894957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.896719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504cc77-5835-44e6-96b0-eeb8b8d6eb06 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.911324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 954/1884] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:05.912772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:05.925882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e040766-9bfc-4e66-85a5-6fde55bc67db admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:05.931627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:05.937650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.937650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.937650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] PATH_INFO: `/v3/projects/97fdac284efd41ba938aa8b9155e7b80/users/32ea833f94a046c3a27245552d36acea/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.937650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fdac284efd41ba938aa8b9155e7b80, user_id=32ea833f94a046c3a27245552d36acea, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:05.938519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:05.951974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 931/1885] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:05 2022] PUT /identity/v3/projects/97fdac284efd41ba938aa8b9155e7b80/users/32ea833f94a046c3a27245552d36acea/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:05.967071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:05.967444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:05.967796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:05.999167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] MFA Rules not processed for user `32ea833f94a046c3a27245552d36acea`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:06.000936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:06.080446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 955/1886] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:06.091580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:06.093326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:06.153498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00a0c6-d2df-4d73-bedb-e50541910bfc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:06.158654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:06.159790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:06.160080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:06.160358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:06.172065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:06.173851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986716e-e541-41ab-ab93-a53a0fa3934d service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:06.186260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 932/1887] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:06.318595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:07.817216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:08.787314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:08.865168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0cc70-7f6e-4234-8555-8d9128eb896c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:08.872224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:08.873166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:08.873456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:08.873737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] PATH_INFO: `/v3/users/002bc19390f843aa9b4b9535806c0766` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:08.875008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] RBAC: Authorizing `identity:delete_user(user_id=002bc19390f843aa9b4b9535806c0766)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:08.877346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:09.031980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:09.138802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002bc19390f843aa9b4b9535806c0766'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:09.206520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002bc19390f843aa9b4b9535806c0766'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:09.207249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002bc19390f843aa9b4b9535806c0766'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:09.216485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002bc19390f843aa9b4b9535806c0766'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:09.232445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002bc19390f843aa9b4b9535806c0766'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:09.239639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 956/1888] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:08 2022] DELETE /identity/v3/users/002bc19390f843aa9b4b9535806c0766 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:09.244323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:09.244775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:09.244888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:09.263721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:09.264942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:09.332150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 933/1889] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:09.341810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:09.343285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:09.413078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd795e-c3fb-466a-afc0-34e84902002b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:09.417434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:09.418398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:09.418887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:09.419315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:09.451926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:09.456158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:09.476155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 957/1890] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:10.010752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:10.012215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:10.025234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f062c-172a-46ba-a0d3-473206252579 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:10.030027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:10.030942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:10.031226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:10.031506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] PATH_INFO: `/v3/projects/f439715e56a24fa1841df05f6cb045f7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:10.033526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f439715e56a24fa1841df05f6cb045f7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:10.036276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:10.083589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:10.193880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f439715e56a24fa1841df05f6cb045f7', 'request_id': 'req-b50caa7c-b861-42fa-99d2-81d7a47404b5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.199725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f439715e56a24fa1841df05f6cb045f7', 'request_id': 'req-b50caa7c-b861-42fa-99d2-81d7a47404b5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.206209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f439715e56a24fa1841df05f6cb045f7', 'request_id': 'req-b50caa7c-b861-42fa-99d2-81d7a47404b5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.370017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] The token cache is being invalidate because project f439715e56a24fa1841df05f6cb045f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:10.370674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.371102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.372909 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 934/1891] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:10 2022] DELETE /identity/v3/projects/f439715e56a24fa1841df05f6cb045f7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:10.378098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:10.387993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3f10-ace2-4fe8-846d-dae75f95e41b service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:10.450442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:10.451815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:10.451815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:10.451998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] PATH_INFO: `/v3/users/32ea833f94a046c3a27245552d36acea` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:10.453267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ea833f94a046c3a27245552d36acea)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:10.455809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:10.691743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ea833f94a046c3a27245552d36acea'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.758062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ea833f94a046c3a27245552d36acea'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.759052 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ea833f94a046c3a27245552d36acea'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.770751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ea833f94a046c3a27245552d36acea'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.784610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8db0f26-2644-4cb2-9884-55317c3fd0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ea833f94a046c3a27245552d36acea'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:10.791124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 958/1892] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:10 2022] DELETE /identity/v3/users/32ea833f94a046c3a27245552d36acea => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:10.797808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:10.800616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:10.814608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50caa7c-b861-42fa-99d2-81d7a47404b5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:10.881276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:10.882715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:10.883190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:10.883711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] PATH_INFO: `/v3/users/0ec00310986d460489a23df7a95c62dc` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:10.887190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec00310986d460489a23df7a95c62dc)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:10.891893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:11.004501 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:11.188722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec00310986d460489a23df7a95c62dc'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.190177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec00310986d460489a23df7a95c62dc'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.295023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec00310986d460489a23df7a95c62dc'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.299664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec00310986d460489a23df7a95c62dc'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.313504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec00310986d460489a23df7a95c62dc'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.329200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 935/1893] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:10 2022] DELETE /identity/v3/users/0ec00310986d460489a23df7a95c62dc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:11.333831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:11.334022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:11.334308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:11.367117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:11.368482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:11.435944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 959/1894] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:11.447825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:11.449581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:11.519030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65661-8327-468f-b7ff-2823d107bd90 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:11.523712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:11.526619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:11.526619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:11.526619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:11.537639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:11.539186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230940e5-a463-48e2-8684-d4ff79087896 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:11.549983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 936/1895] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:11.611764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:11.615055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:11.616746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:11.638066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9ea10-a907-4dd5-b958-04b5597c7b5e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:11.644549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:11.645797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:11.646322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:11.647104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] PATH_INFO: `/v3/projects/97fdac284efd41ba938aa8b9155e7b80` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:11.652057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fdac284efd41ba938aa8b9155e7b80)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:11.652057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:11.839065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fdac284efd41ba938aa8b9155e7b80', 'request_id': 'req-503db9a2-5227-4bfa-bae9-f7090c1cee40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.923644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fdac284efd41ba938aa8b9155e7b80', 'request_id': 'req-503db9a2-5227-4bfa-bae9-f7090c1cee40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.930211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fdac284efd41ba938aa8b9155e7b80', 'request_id': 'req-503db9a2-5227-4bfa-bae9-f7090c1cee40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.942114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] The token cache is being invalidate because project 97fdac284efd41ba938aa8b9155e7b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:11.942425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.943080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-503db9a2-5227-4bfa-bae9-f7090c1cee40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:11.944632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 960/1896] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:11 2022] DELETE /identity/v3/projects/97fdac284efd41ba938aa8b9155e7b80 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:11.950759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:11.951061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:11.951356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:11.969503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:11.970971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.031394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 937/1897] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:12.040040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.040335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.040620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.044790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.046285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.063539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:12.064108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa3d5-eab2-4eb3-95bb-4a2e502c7fc6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.064824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.068920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.071503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.071804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.072088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] PATH_INFO: `/v3/projects/d352af915216487c99169c8b436fdec7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.073405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d352af915216487c99169c8b436fdec7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.074152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 961/1898] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:12.075628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.079102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.090972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a270033-eeea-4f9f-95ab-c584564403a9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.098333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.099109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.099394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.099669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.100405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:12.100720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.103512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.117333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 962/1899] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:12.121814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.132232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175035-1ad2-42a1-8e4d-38a1515672fe admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.137507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.138260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.138601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.138882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.139635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.141568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.232408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd352af915216487c99169c8b436fdec7', 'request_id': 'req-f7191093-2a9f-4556-9ef3-b18921e81e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.237809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd352af915216487c99169c8b436fdec7', 'request_id': 'req-f7191093-2a9f-4556-9ef3-b18921e81e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.243941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd352af915216487c99169c8b436fdec7', 'request_id': 'req-f7191093-2a9f-4556-9ef3-b18921e81e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.274466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 963/1900] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:12.278530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.330428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] The token cache is being invalidate because project d352af915216487c99169c8b436fdec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:12.331066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.332058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.334021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 938/1901] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:12 2022] DELETE /identity/v3/projects/d352af915216487c99169c8b436fdec7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:12.337721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.339562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.347434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b596d-9d5f-486b-87af-8361e74cf00a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.353238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.354035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.354569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.354923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.355686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.358316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.409869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7191093-2a9f-4556-9ef3-b18921e81e37 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.415870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.416829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.417128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.417398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] PATH_INFO: `/v3/users/448ad4339b074436b57476a7e85bad0c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.419534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448ad4339b074436b57476a7e85bad0c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.430006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.461639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 964/1902] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:12.464152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.465760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.478490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a93d-89d5-499b-969f-af74c1bff6b4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.483262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.483926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.484215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.484551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.485278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.486987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.496809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 965/1903] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:12.500700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.510478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0ae5-867c-427e-8c94-07fe2bd0c646 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.515129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.515747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.516048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.516320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.517632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.519210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.528819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 966/1904] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:12.533251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.543568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01d17-856b-4496-96d1-e6d8a45866bf admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.548979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.550047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.550372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.550688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] PATH_INFO: `/v3/projects/50fe6cc5a5a5404689db56d75bc6e1e9/users/982df18bcfd1454b84db7f705f4d5cdd/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.567748 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:12.572442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fe6cc5a5a5404689db56d75bc6e1e9, user_id=982df18bcfd1454b84db7f705f4d5cdd, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.575213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8d553-72c4-4157-b58a-8d44b0c7215e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.629261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448ad4339b074436b57476a7e85bad0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.630535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448ad4339b074436b57476a7e85bad0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.649737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 967/1905] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:12 2022] PUT /identity/v3/projects/50fe6cc5a5a5404689db56d75bc6e1e9/users/982df18bcfd1454b84db7f705f4d5cdd/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:12.661167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.661470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.661763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.689686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] MFA Rules not processed for user `982df18bcfd1454b84db7f705f4d5cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:12.690875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.723614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448ad4339b074436b57476a7e85bad0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.724512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448ad4339b074436b57476a7e85bad0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.745030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448ad4339b074436b57476a7e85bad0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:12.759084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 939/1906] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:12 2022] DELETE /identity/v3/users/448ad4339b074436b57476a7e85bad0c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:12.768054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 968/1907] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:12.769346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:12.770880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:12.847561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec1fb8-e03c-4f28-a972-2c5c83f5c1a3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:12.853244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:12.854158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:12.854472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:12.855016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:12.855731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:12.857834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:12.962493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 940/1908] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:12.964808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.048830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a647-c5ff-4a09-8e5f-34d61f04f0fb None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.115506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.116280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.116634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.116999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.117773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.120545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.215363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:13.224364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.224968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.229101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 969/1909] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:12 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:13.230482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.241873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eddae-eef8-4ea1-a74c-08f4fa814783 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.247631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.248379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.248872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.259164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.259164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.259375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014bcef-d270-4ae6-8f96-d35342a97251 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.259471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.259556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.259556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.259556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.259556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] PATH_INFO: `/v3/projects/66c28033ea8f4d688989b79cb3bf2938` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.260648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c28033ea8f4d688989b79cb3bf2938)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.262762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.282077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 970/1910] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:13.287708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.300629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de48a42-8486-45ff-947a-eca612d8ddab admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.307334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.308581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.309853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.310484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.316297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.316297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.327856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 971/1911] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:13.328732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.339208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ce5e-10f5-422d-a0c9-9d716e467992 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.346018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.346018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.346018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.346018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] PATH_INFO: `/v3/projects/79a844e995824fed901ae5b7eddea450/users/1fbeeb1bcb3e4de4a3be2ca0ad5af719/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.363411 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a844e995824fed901ae5b7eddea450, user_id=1fbeeb1bcb3e4de4a3be2ca0ad5af719, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.366110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d792a28-0b25-4948-bf4e-63e0509055fa admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.455859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 972/1912] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:13 2022] PUT /identity/v3/projects/79a844e995824fed901ae5b7eddea450/users/1fbeeb1bcb3e4de4a3be2ca0ad5af719/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:13.466977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.467852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.468383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.499981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c28033ea8f4d688989b79cb3bf2938', 'request_id': 'req-a4451d39-8c35-4acf-8965-9a9702b203bb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:13.506794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c28033ea8f4d688989b79cb3bf2938', 'request_id': 'req-a4451d39-8c35-4acf-8965-9a9702b203bb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:13.508489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] MFA Rules not processed for user `1fbeeb1bcb3e4de4a3be2ca0ad5af719`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:13.510527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.535923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c28033ea8f4d688989b79cb3bf2938', 'request_id': 'req-a4451d39-8c35-4acf-8965-9a9702b203bb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:13.577812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 973/1913] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:13.582800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.611976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:13.617494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] The token cache is being invalidate because project 66c28033ea8f4d688989b79cb3bf2938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:13.618242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:13.619374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4451d39-8c35-4acf-8965-9a9702b203bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:13.627234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 941/1914] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:13 2022] DELETE /identity/v3/projects/66c28033ea8f4d688989b79cb3bf2938 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:13.628712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf9e9-fcb7-4bf9-9bce-efe54711f373 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.629016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf9e9-fcb7-4bf9-9bce-efe54711f373 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.629282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf9e9-fcb7-4bf9-9bce-efe54711f373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.650168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3d4bf9e9-fcb7-4bf9-9bce-efe54711f373 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:13.653000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3d4bf9e9-fcb7-4bf9-9bce-efe54711f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.673169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dae85-3447-4e10-9247-55e5b7c0eed7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.678447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 942/1915] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:13.678758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.679494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.686970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.686970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.686970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.686970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.694970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.695495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.695940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.717192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:13.718439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.727375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 943/1916] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:13.731484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.740793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd29fc-a0c0-4670-a353-57c1ce754cd2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.746994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.747646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.747927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.748201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.748936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:13.749744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.751981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.763851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 944/1917] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:13.768598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.778220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce3bd5-d3bc-425e-a39e-d5c07d420efa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.783164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.783875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.784217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.784491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.785190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.787109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.802847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 974/1918] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:13.804210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.805852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.872000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9164-ba1c-4e10-8392-efb08f559973 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.877515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.878205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.878545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.878824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.879521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.881510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.885703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 945/1919] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:13.887956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.900077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:13.968748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bacf5-defd-478a-9e0d-b786ea5e094d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.972732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 975/1920] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:13.973875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:13.977305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.978289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.979869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.979869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] PATH_INFO: `/v3/users/7e7f8e73ac554d8e982a6b7b3cfdfa15` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.981270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7f8e73ac554d8e982a6b7b3cfdfa15)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.983337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:13.986061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0ade1-026e-47ff-927b-141bb1533e35 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:13.992151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:13.992823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:13.993107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:13.993386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:13.994147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:13.996133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.101441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 976/1921] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:13 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:14.102137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.112304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305dbc-863d-4054-9336-544dcaa31392 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.116930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.123378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.123378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.123378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.123378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.123378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.133080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 977/1922] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:14.133916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.144980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deb725-5ab2-4155-8921-76401e960d7a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.149918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.151861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.151861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.151861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.152115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.153626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.164499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 978/1923] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:14.165343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.175879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebeed-be82-479c-a1f1-403962caccf8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.180900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.181783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.182072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.182352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] PATH_INFO: `/v3/projects/4fdea3199a0b419ea99602bb0ac67936/users/15ee4a1b06374d729791ad6757322caf/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.198124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdea3199a0b419ea99602bb0ac67936, user_id=15ee4a1b06374d729791ad6757322caf, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.200831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.269527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7f8e73ac554d8e982a6b7b3cfdfa15'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:14.270195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7f8e73ac554d8e982a6b7b3cfdfa15'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:14.284002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 979/1924] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:14 2022] PUT /identity/v3/projects/4fdea3199a0b419ea99602bb0ac67936/users/15ee4a1b06374d729791ad6757322caf/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:14.285070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.341601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7f8e73ac554d8e982a6b7b3cfdfa15'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:14.342754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7f8e73ac554d8e982a6b7b3cfdfa15'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:14.359528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7f8e73ac554d8e982a6b7b3cfdfa15'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:14.372445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760474e-6e9d-4d05-ab4f-7a89534f67c7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.374639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 946/1925] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:13 2022] DELETE /identity/v3/users/7e7f8e73ac554d8e982a6b7b3cfdfa15 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:14.376434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.378881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.455158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.455895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.456183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.456462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.457697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.459484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355ec23-d77d-4854-856b-5923e7f05585 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.469712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dfd18-98e2-4fe4-ab86-eb28095d0a52 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.474381 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 980/1926] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:14.474894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.475408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.475761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.476158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.477575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.478695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.481002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.482045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.482662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.491595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 947/1927] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:14.492441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.494151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.506359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:14.508634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.510918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18eef5-2b85-461d-aa08-77ff94b61a67 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.517263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.518980 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 981/1928] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:14.520417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.520539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.521269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.521269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] PATH_INFO: `/v3/projects/a9464d1a9dc24a1681b344ff3032405f/users/89ad2fed9de14251bd970d8fcda77224/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.522592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:14.535364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97440f-f8f7-46b7-8981-749555073918 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.542448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.543357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.543644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.543924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] PATH_INFO: `/v3/projects/4fdea3199a0b419ea99602bb0ac67936/users/15ee4a1b06374d729791ad6757322caf/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.546038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdea3199a0b419ea99602bb0ac67936, user_id=15ee4a1b06374d729791ad6757322caf, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.548866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9464d1a9dc24a1681b344ff3032405f, user_id=89ad2fed9de14251bd970d8fcda77224, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.549158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.554805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78aef5-91d1-45bd-b64d-0550ee74ef98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.566495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 982/1929] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:14 2022] PUT /identity/v3/projects/4fdea3199a0b419ea99602bb0ac67936/users/15ee4a1b06374d729791ad6757322caf/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:14.567800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.571181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.639099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 948/1930] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:14 2022] PUT /identity/v3/projects/a9464d1a9dc24a1681b344ff3032405f/users/89ad2fed9de14251bd970d8fcda77224/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:14.640952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ef0-bf1e-4e33-ad42-9569755253be None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.641248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ef0-bf1e-4e33-ad42-9569755253be None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.642372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ef0-bf1e-4e33-ad42-9569755253be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.644771 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372120-7115-469c-80ef-655dfd34b67c admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.683482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5fbc9ef0-bf1e-4e33-ad42-9569755253be None None] MFA Rules not processed for user `15ee4a1b06374d729791ad6757322caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:14.684891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5fbc9ef0-bf1e-4e33-ad42-9569755253be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.755585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.756354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.756714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.757086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.775420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:14.806218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 949/1931] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:14.808376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.808800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.809177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.841882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] MFA Rules not processed for user `89ad2fed9de14251bd970d8fcda77224`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:14.843353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.900960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.903735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:14.912026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:14.918120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 983/1932] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:14.919253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.921407 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:14.960165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 950/1933] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:14.965381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:14.982126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4cb6a-1147-4d0e-988b-8752e90a3f42 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:14.992537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:14.994885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:14.995695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:14.995695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:14.996977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:14.999993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.039145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1217-1bb6-49ba-8c8a-88167e12b089 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.049664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.050825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.051208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.051505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.054509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:15.137897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 951/1934] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:14 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:15.142881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.166209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.168507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.190550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 984/1935] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:15.235435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274287a7-4d67-48e3-b6ce-d0a0d104f939 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.240771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.241457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.241740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.242014 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.243485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.246869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.326214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:15.334004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 952/1936] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:15 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:15.338033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.352751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507517-c265-4a2a-890f-5fb135c42dea service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.367677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.368765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.369476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.370137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.372000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.374876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.406299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.416948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 985/1937] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:15.424423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fa925-a98e-48d8-bfd0-12ef2daabfb7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.449517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.456144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.456497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.456839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] PATH_INFO: `/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468/users/04317e6fca8d4e059d971edfd68bd982/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.497760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca9b4eb307244318f8ed7e24e9e8468, user_id=04317e6fca8d4e059d971edfd68bd982, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.502338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.599397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 953/1938] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:15 2022] PUT /identity/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468/users/04317e6fca8d4e059d971edfd68bd982/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:15.609654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.620762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732cdd4-48b3-449c-998c-ded19ef659c9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.683963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.684886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.685172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.685445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.686168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.687830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c786fa-b159-4113-9517-12325d83fe2f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.698735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 986/1939] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:15.702929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.715447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f606f-c7d4-43ab-bbc3-3fdd29774809 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:15.722534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:15.724254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.724658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.725035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] PATH_INFO: `/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468/users/04317e6fca8d4e059d971edfd68bd982/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.727886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca9b4eb307244318f8ed7e24e9e8468, user_id=04317e6fca8d4e059d971edfd68bd982, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:15.732344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:15.747939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 954/1940] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:15 2022] PUT /identity/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468/users/04317e6fca8d4e059d971edfd68bd982/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:15.759841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:15.760180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:15.760461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:15.797072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] MFA Rules not processed for user `04317e6fca8d4e059d971edfd68bd982`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:15.799022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:15.898887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 987/1941] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:15.907779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:15.910513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:15.936098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:15.989646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0307ef-5e66-4c5d-bffb-6495e115c8d0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:16.003987 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:16.004825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:16.005121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:16.005404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:16.020758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:16.022536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:16.035715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 955/1942] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:16.096108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:16.312895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:16.398780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83557dda-64d6-4cc8-ab98-fbf6e8176b75 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:16.404107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:16.404994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:16.405279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:16.405562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] PATH_INFO: `/v3/users/89ad2fed9de14251bd970d8fcda77224` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:16.406804 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ad2fed9de14251bd970d8fcda77224)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:16.409802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:16.496418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:16.502697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:16.531795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969434e-fdf3-4d51-9fba-96e2d898f257 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:16.548531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:16.549503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:16.549725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:16.550004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] PATH_INFO: `/v3/projects/8d6c771ca26e4198857b3fdbce7add70` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:16.552072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6c771ca26e4198857b3fdbce7add70)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:16.554503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:16.692048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ad2fed9de14251bd970d8fcda77224'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.692564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6c771ca26e4198857b3fdbce7add70', 'request_id': 'req-206008c9-97e7-4127-aa2a-39bd1e7ab15f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.701932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6c771ca26e4198857b3fdbce7add70', 'request_id': 'req-206008c9-97e7-4127-aa2a-39bd1e7ab15f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.713005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6c771ca26e4198857b3fdbce7add70', 'request_id': 'req-206008c9-97e7-4127-aa2a-39bd1e7ab15f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.775600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ad2fed9de14251bd970d8fcda77224'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.776337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ad2fed9de14251bd970d8fcda77224'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.786078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ad2fed9de14251bd970d8fcda77224'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.805193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4329a266-3692-4366-b343-5062686fa227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ad2fed9de14251bd970d8fcda77224'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.822824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 988/1943] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:16 2022] DELETE /identity/v3/users/89ad2fed9de14251bd970d8fcda77224 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:16.826184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:16.827674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:16.828295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:16.837776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] The token cache is being invalidate because project 8d6c771ca26e4198857b3fdbce7add70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:16.838072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.841718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:16.841718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 956/1944] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:16 2022] DELETE /identity/v3/projects/8d6c771ca26e4198857b3fdbce7add70 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:16.849149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:16.849149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:16.867934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:16.869597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:16.966602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 989/1945] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:16.976749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:16.979205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:16.981707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206008c9-97e7-4127-aa2a-39bd1e7ab15f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:16.988316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:16.993997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:16.993997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:16.993997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] PATH_INFO: `/v3/users/5b6f0f2bef7941ec8f8120893f7f92f1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:16.993997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6f0f2bef7941ec8f8120893f7f92f1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:16.993997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:17.044556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ac8e-0de5-4a9b-9651-ff9d97fbb9b8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:17.049310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:17.050124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:17.050438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:17.050721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:17.061219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:17.062621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:17.074535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 990/1946] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:17.238201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6f0f2bef7941ec8f8120893f7f92f1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:17.238933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6f0f2bef7941ec8f8120893f7f92f1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:17.369556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6f0f2bef7941ec8f8120893f7f92f1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:17.370118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6f0f2bef7941ec8f8120893f7f92f1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:17.398019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6f0f2bef7941ec8f8120893f7f92f1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:17.425844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 957/1947] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:16 2022] DELETE /identity/v3/users/5b6f0f2bef7941ec8f8120893f7f92f1 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:17.489266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:17.925209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:17.936953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787fb6-0917-4194-8e2d-b8282fc391ff service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:17.946354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:17.964557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:17.966878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:18.027347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.028240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.028532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.028810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] PATH_INFO: `/v3/projects/4f51606c08bd49f294fd25bdcc3f5290` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.030294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f51606c08bd49f294fd25bdcc3f5290)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.033167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.077002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020560a8-2d2a-4297-abc0-02cbdf548bf2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:18.084054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.084938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.085222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.085502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] PATH_INFO: `/v3/projects/a9464d1a9dc24a1681b344ff3032405f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.086883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9464d1a9dc24a1681b344ff3032405f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.089158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.142374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f51606c08bd49f294fd25bdcc3f5290', 'request_id': 'req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.248788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f51606c08bd49f294fd25bdcc3f5290', 'request_id': 'req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.256241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f51606c08bd49f294fd25bdcc3f5290', 'request_id': 'req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.266375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9464d1a9dc24a1681b344ff3032405f', 'request_id': 'req-ddc8648e-6b1f-40e9-b2c5-c5957b832231'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.266375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9464d1a9dc24a1681b344ff3032405f', 'request_id': 'req-ddc8648e-6b1f-40e9-b2c5-c5957b832231'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.270900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] The token cache is being invalidate because project 4f51606c08bd49f294fd25bdcc3f5290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:18.271216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.271540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9464d1a9dc24a1681b344ff3032405f', 'request_id': 'req-ddc8648e-6b1f-40e9-b2c5-c5957b832231'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.272132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7f4f0fc2-815f-4ee7-aff0-82f6ed9a9aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.274233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 991/1948] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:17 2022] DELETE /identity/v3/projects/4f51606c08bd49f294fd25bdcc3f5290 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:18.280517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc6ece-e1b8-46ab-a51b-65a08da95124 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.281029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc6ece-e1b8-46ab-a51b-65a08da95124 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.281438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc6ece-e1b8-46ab-a51b-65a08da95124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.303868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f4fc6ece-e1b8-46ab-a51b-65a08da95124 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:18.305068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f4fc6ece-e1b8-46ab-a51b-65a08da95124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:18.364491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 992/1949] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:18.488251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.488547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.488831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.508524 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:18.509726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:18.518033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 993/1950] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:18.544483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:18.550981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffa6e2-70bc-435b-93d6-a86af5ded1dd None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:18.556109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.556772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.557057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.557336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.558058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:18.558369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.559997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.572011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 994/1951] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:18.582574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:18.592135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8928c94-5b01-4191-9590-3991834b1b19 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:18.598244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.599084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.599370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.599652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.600890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.602853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.624917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] The token cache is being invalidate because project a9464d1a9dc24a1681b344ff3032405f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:18.624917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.624917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.624917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 958/1952] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:17 2022] DELETE /identity/v3/projects/a9464d1a9dc24a1681b344ff3032405f => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:18.624917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:18.625602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:18.634768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8648e-6b1f-40e9-b2c5-c5957b832231 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:18.639576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.640440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.640731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.641042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] PATH_INFO: `/v3/users/04317e6fca8d4e059d971edfd68bd982` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.642795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04317e6fca8d4e059d971edfd68bd982)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.644729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.818492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 995/1953] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:18.822456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:18.824953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:18.920595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04aad6-d832-400c-8625-e3d7d8009e6a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:18.922862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:18.923639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:18.923944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:18.924209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:18.924915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:18.927171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:18.972994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04317e6fca8d4e059d971edfd68bd982'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:18.973686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04317e6fca8d4e059d971edfd68bd982'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.072256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 996/1954] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:18 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:19.072903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.074470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.081280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04317e6fca8d4e059d971edfd68bd982'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.082041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04317e6fca8d4e059d971edfd68bd982'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.096282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04317e6fca8d4e059d971edfd68bd982'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.109298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 959/1955] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:18 2022] DELETE /identity/v3/users/04317e6fca8d4e059d971edfd68bd982 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:19.110270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.111885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.137669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a9aa5-0cc3-418d-924c-245f1e2c69ac admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.197789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.198785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.199076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.199465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.213165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.214793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011c4ec-5822-4c0e-ad9b-9a85c99ee0b5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.222259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.222978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.223369 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.223801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.224646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.226272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.241511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 960/1956] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:19.246325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.257639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae50e7-a45e-434b-a364-2eaf5d650fc6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.264337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.268556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.268556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.268556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.268556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.270139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.281736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 961/1957] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:19.286958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.297154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003fcc6-efc9-4acb-a710-e5fc6f69867f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.303283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.304234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.304521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.304800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] PATH_INFO: `/v3/projects/e09ba6e232ae4841a5ea4f162bef7cea/users/ba5f299830fe4f6a97be16065aed63c2/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.328481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09ba6e232ae4841a5ea4f162bef7cea, user_id=ba5f299830fe4f6a97be16065aed63c2, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.332141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.343384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.345537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873dc02-c323-41cd-8ff1-013050d60d9a service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.355045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 997/1958] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:19.505976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 962/1959] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:19 2022] PUT /identity/v3/projects/e09ba6e232ae4841a5ea4f162bef7cea/users/ba5f299830fe4f6a97be16065aed63c2/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:19.517910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.523250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.523250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.546689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] MFA Rules not processed for user `ba5f299830fe4f6a97be16065aed63c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:19.552218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.618040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 998/1960] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:19.622506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.683569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967785-61eb-4601-956e-6f522fa107f8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.689292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.689965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.690247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.690554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.691238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.693188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.708886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.710668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.725690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aad7d3-c992-4134-bf3e-d89e50aef7aa None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.730491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.731502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.731858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.732205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] PATH_INFO: `/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.734223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca9b4eb307244318f8ed7e24e9e8468)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.736494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.844074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 963/1961] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:19 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:19.845704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:19.854138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca9b4eb307244318f8ed7e24e9e8468', 'request_id': 'req-55b14b03-6988-4057-981d-7b25f0d6253a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.911742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca9b4eb307244318f8ed7e24e9e8468', 'request_id': 'req-55b14b03-6988-4057-981d-7b25f0d6253a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.925027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca9b4eb307244318f8ed7e24e9e8468', 'request_id': 'req-55b14b03-6988-4057-981d-7b25f0d6253a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.935889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390f9f-1891-437a-a258-3a3c11fdfa4e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:19.941644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:19.942476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.942932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.943307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.944180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:19.945401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] The token cache is being invalidate because project 8ca9b4eb307244318f8ed7e24e9e8468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:19.945828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.946504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-55b14b03-6988-4057-981d-7b25f0d6253a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:19.946882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:19.948150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 999/1962] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:19 2022] DELETE /identity/v3/projects/8ca9b4eb307244318f8ed7e24e9e8468 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:19.952952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5ea7-9cf9-4339-8ea6-5f38b2f489f0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.953307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5ea7-9cf9-4339-8ea6-5f38b2f489f0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.953641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5ea7-9cf9-4339-8ea6-5f38b2f489f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:19.973271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4fcd5ea7-9cf9-4339-8ea6-5f38b2f489f0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:19.975734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:19.976570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4fcd5ea7-9cf9-4339-8ea6-5f38b2f489f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:19.984821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1000/1963] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:19.993288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:19.993580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:19.993863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.013485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:20.014794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.023947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1001/1964] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:20.033012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.042350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ea0e3-f35c-4b7a-8a3d-7e869f6d4037 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.049225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.049997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.050603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.050975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.052367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:20.052792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.059669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.068152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 964/1965] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:19 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:20.072042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.075343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.077027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1002/1966] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:20.084532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.093050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b623e-95af-415b-bcc7-6612bf2b4cdf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.095568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36339ed-e767-44ef-9f8a-124d4b411e84 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.103845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.104537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.105142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.105460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.105808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.105915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.106113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.106375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.109735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.109994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.110106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.110211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.119877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 965/1967] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:20.124166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.134235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84015577-e65d-4e21-85d1-02422b04958c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.139017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.140372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.140372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.140545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] PATH_INFO: `/v3/projects/50e1a3d522614552ac3ef41b4d455659/users/947b21e19bcb436fa75e8932bdb30fda/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.165208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1a3d522614552ac3ef41b4d455659, user_id=947b21e19bcb436fa75e8932bdb30fda, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.168023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.187923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1003/1968] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:20 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:20.191367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.203580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:20.261022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 966/1969] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:20 2022] PUT /identity/v3/projects/50e1a3d522614552ac3ef41b4d455659/users/947b21e19bcb436fa75e8932bdb30fda/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:20.268715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.271556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229997-c27e-4035-997f-dfebe6790ab0 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.331347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.332029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.332319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.332981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.333659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.334594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a189f-6288-4cf2-b6aa-09826a9e31c6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.336347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.339281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.339949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.340406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.340700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.341416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.343076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.354509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 967/1970] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:20.358983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.371489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1cb33-90f0-4a89-9d33-ca60d8716915 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.378127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.379106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.379397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.379677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] PATH_INFO: `/v3/projects/50e1a3d522614552ac3ef41b4d455659/users/947b21e19bcb436fa75e8932bdb30fda/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.383022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1a3d522614552ac3ef41b4d455659, user_id=947b21e19bcb436fa75e8932bdb30fda, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.384436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972d7d7-d2f0-4de6-a640-6e8de87a4d35 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.396922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 968/1971] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:20 2022] PUT /identity/v3/projects/50e1a3d522614552ac3ef41b4d455659/users/947b21e19bcb436fa75e8932bdb30fda/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:20.408757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.409202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.409488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.437944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] MFA Rules not processed for user `947b21e19bcb436fa75e8932bdb30fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:20.439914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.446362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1004/1972] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:20 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:20.450735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.463139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d3ff-f053-4920-b7c0-a0cddb235e55 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.534973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 969/1973] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:20.555018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.555804 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.556058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.556341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.557074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.558749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.569542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1005/1974] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:20.575533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.584952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdafce0-3f27-4163-97b9-9f7a7eb62893 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.589942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.590541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.590971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.591185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.591916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.593528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.606654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 970/1975] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:20.607872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.617892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55060d1f-b246-453a-9084-f46178bf8e4b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.622856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.623833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.624090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.624830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] PATH_INFO: `/v3/projects/c7ece76f926042a38c8a191d97384f56/users/cb581b6edcfa439da6c63f2bb647d57a/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.639569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:20.648333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ece76f926042a38c8a191d97384f56, user_id=cb581b6edcfa439da6c63f2bb647d57a, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.651056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350397a8-3104-4a6d-99fe-4260cd6f00b3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.676292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.678777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.738526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1006/1976] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:20 2022] PUT /identity/v3/projects/c7ece76f926042a38c8a191d97384f56/users/cb581b6edcfa439da6c63f2bb647d57a/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:20.744684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d80f-5ea8-48dd-9eb9-0afffd5ab5bc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.745322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.745787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.746208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.774928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] MFA Rules not processed for user `cb581b6edcfa439da6c63f2bb647d57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:20.776473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.796088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.796770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.797057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.797337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.800452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:20.844337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1007/1977] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:20.867928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.869431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.879721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 971/1978] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:20.900563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:20.958502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:20.968542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265623-0019-47a0-b126-2d4806cf3478 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:20.974129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:20.974859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:20.981311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:20.981311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:20.983772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:20.985413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:20.994337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1008/1979] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:21.014234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:21.091516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c2113-7e0a-493b-88cf-a88121669fbd service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:21.096307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:21.097186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:21.097496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:21.097771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] PATH_INFO: `/v3/users/cb581b6edcfa439da6c63f2bb647d57a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:21.099052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb581b6edcfa439da6c63f2bb647d57a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:21.101028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:21.203642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:21.368854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:21.370279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:21.383071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215715-b345-4fed-aa05-ce5b2765ea62 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:21.388410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:21.389070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:21.389362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:21.389770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:21.393552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:21.399090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb581b6edcfa439da6c63f2bb647d57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:21.399812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb581b6edcfa439da6c63f2bb647d57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:21.459126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:21.460564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fbba5-09a0-4da0-a9f9-b908c3afbc20 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:21.470977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1009/1980] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:21.517980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb581b6edcfa439da6c63f2bb647d57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:21.523385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb581b6edcfa439da6c63f2bb647d57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:21.529710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:21.535466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb581b6edcfa439da6c63f2bb647d57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:21.547910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 972/1981] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:21 2022] DELETE /identity/v3/users/cb581b6edcfa439da6c63f2bb647d57a => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:21.552988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:21.553287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:21.558365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:21.571482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:21.572826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:21.641985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1010/1982] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:21.651790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:21.653241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:21.725719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6bc7-057f-47aa-bf98-1d20abec5a15 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:21.733015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:21.733287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:21.733555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:21.733834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:21.762081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:21.763916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:21.776632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 973/1983] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:21.920015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:21.921690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:21.935533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364728-f37e-409d-89c6-074f3aaf3137 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:21.940519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:21.941396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:21.941678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:21.941973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] PATH_INFO: `/v3/users/2ff6cc385afd4c2ca01a261dcdbd5cd9` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:21.943215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff6cc385afd4c2ca01a261dcdbd5cd9)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:21.945191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:21.957910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:22.173320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff6cc385afd4c2ca01a261dcdbd5cd9'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.270437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.272241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.288796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bec0-c474-47ff-80ab-eb021cefc410 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:22.294277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:22.295273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.295623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.295980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] PATH_INFO: `/v3/projects/c7ece76f926042a38c8a191d97384f56` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.297248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ece76f926042a38c8a191d97384f56)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:22.299542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:22.339884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff6cc385afd4c2ca01a261dcdbd5cd9'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.342796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff6cc385afd4c2ca01a261dcdbd5cd9'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.349954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff6cc385afd4c2ca01a261dcdbd5cd9'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.363633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-cdf47726-617a-4905-a35f-c68883eba6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff6cc385afd4c2ca01a261dcdbd5cd9'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.369797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1011/1984] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:21 2022] DELETE /identity/v3/users/2ff6cc385afd4c2ca01a261dcdbd5cd9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:22.374005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.374297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.374634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.393380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:22.394952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.430281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ece76f926042a38c8a191d97384f56', 'request_id': 'req-edb595b7-09b9-4f5e-abd4-d4da06b744e7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.437636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ece76f926042a38c8a191d97384f56', 'request_id': 'req-edb595b7-09b9-4f5e-abd4-d4da06b744e7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.445480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ece76f926042a38c8a191d97384f56', 'request_id': 'req-edb595b7-09b9-4f5e-abd4-d4da06b744e7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.458488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1012/1985] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:22.467852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.469379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.536171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6dd5-b943-49f3-aa99-09df1a0513bc None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:22.555850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] The token cache is being invalidate because project c7ece76f926042a38c8a191d97384f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:22.556319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.557283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-edb595b7-09b9-4f5e-abd4-d4da06b744e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.559697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 974/1986] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:22 2022] DELETE /identity/v3/projects/c7ece76f926042a38c8a191d97384f56 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:22.565615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.570850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.570850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.585837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:22.587171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.591449 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:22.594068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.594068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.594068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.594382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.653779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 975/1987] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:22.654798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.656086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.667113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:22.668583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2a70-6204-4029-87d0-52d4b8016ad6 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:22.668778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d258db-0a26-4cde-9893-b69acec11079 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:22.673827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:22.674809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.675082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.675360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] PATH_INFO: `/v3/users/96254efdc6c14e7e9ce7de7c09530312` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.676590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96254efdc6c14e7e9ce7de7c09530312)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:22.678850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:22.681516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1013/1988] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:22.682870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.683165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.683445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.708536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:22.709768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:22.718580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1014/1989] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:22.723197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:22.726206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.733831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9cf4d-d3ca-400d-8c48-340d9ae33a8e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:22.739045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:22.739714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.740032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.740317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.741048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:22.741362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:22.743027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:22.761096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1015/1990] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:22.765584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.777443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206ee5a-fa9a-4786-a66b-5bf653ce4949 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:22.783085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:22.783928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:22.784337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:22.784672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:22.785402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:22.787431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:22.879228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1016/1991] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:22 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:22.883395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:22.887695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96254efdc6c14e7e9ce7de7c09530312'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.888383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96254efdc6c14e7e9ce7de7c09530312'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.929373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:22.957489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96254efdc6c14e7e9ce7de7c09530312'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.963231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96254efdc6c14e7e9ce7de7c09530312'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:22.991165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96254efdc6c14e7e9ce7de7c09530312'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.018483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 976/1992] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:22 2022] DELETE /identity/v3/users/96254efdc6c14e7e9ce7de7c09530312 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:23.044621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2e7-824d-4022-970b-64257f6a12e7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.146139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.146982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.147272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.147603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.148313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.151964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.217399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.219144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.239794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fb00-42c7-48e2-810f-dd5961977d12 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.245058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.246153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.246629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.246967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] PATH_INFO: `/v3/projects/e4e035386cd9434fb8718cd364ddfd80` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.248617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e035386cd9434fb8718cd364ddfd80)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.250580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.253117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1017/1993] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:22 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:23.255396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.257279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.270942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5261c4-4a53-4d98-b252-c5116e0726ba admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.275699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.276396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.281302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.281302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.281302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.281302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.290541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1018/1994] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:23.294363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.304932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c980a2-751d-4cde-8611-3b78a191510b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.310047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.310821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.311089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.311358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.311988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.313978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.341788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1019/1995] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:23.341788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.341788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.352532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea7c26-3762-4409-adce-90e41af47093 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.357409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.359194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.359497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.359789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] PATH_INFO: `/v3/projects/b192b5d371514aa2b2be06198a2bba19` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.361566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b192b5d371514aa2b2be06198a2bba19)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.365989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.383914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e035386cd9434fb8718cd364ddfd80', 'request_id': 'req-7390c9ba-b420-4401-8f46-6a4002a9efb3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.389401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e035386cd9434fb8718cd364ddfd80', 'request_id': 'req-7390c9ba-b420-4401-8f46-6a4002a9efb3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.396651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e035386cd9434fb8718cd364ddfd80', 'request_id': 'req-7390c9ba-b420-4401-8f46-6a4002a9efb3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.502453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b192b5d371514aa2b2be06198a2bba19', 'request_id': 'req-4df75a33-cba4-4778-a6c3-26045d11528f'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.528539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] The token cache is being invalidate because project e4e035386cd9434fb8718cd364ddfd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:23.528907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.529545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.534257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 977/1996] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:23 2022] DELETE /identity/v3/projects/e4e035386cd9434fb8718cd364ddfd80 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:23.534257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.534257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.601901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c9ba-b420-4401-8f46-6a4002a9efb3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.614626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b192b5d371514aa2b2be06198a2bba19', 'request_id': 'req-4df75a33-cba4-4778-a6c3-26045d11528f'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.620927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b192b5d371514aa2b2be06198a2bba19', 'request_id': 'req-4df75a33-cba4-4778-a6c3-26045d11528f'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.632683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] The token cache is being invalidate because project b192b5d371514aa2b2be06198a2bba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:23.632976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.633642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:23.635478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1020/1997] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:23 2022] DELETE /identity/v3/projects/b192b5d371514aa2b2be06198a2bba19 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:23.636137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:23.637453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.659572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.660481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.660764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.661042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] PATH_INFO: `/v3/projects/6108723e646b4d2e83096b3052b855c7/users/ed284b03216448c8867c350b98015647/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.675389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6108723e646b4d2e83096b3052b855c7, user_id=ed284b03216448c8867c350b98015647, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.678863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1aa4a-efe0-4fb5-aa12-a6a9d4af56f9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.705973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df75a33-cba4-4778-a6c3-26045d11528f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:23.710656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:23.711530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.711813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.712089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] PATH_INFO: `/v3/users/4bc4bf068b0748a5b2eed8cbe994e007` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.713266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc4bf068b0748a5b2eed8cbe994e007)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:23.715243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:23.830769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 978/1998] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:23 2022] PUT /identity/v3/projects/6108723e646b4d2e83096b3052b855c7/users/ed284b03216448c8867c350b98015647/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:23.830769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b4c3-52e5-4576-a528-d86801f0f9ab None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.830769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b4c3-52e5-4576-a528-d86801f0f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.830769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b4c3-52e5-4576-a528-d86801f0f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.849145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8058b4c3-52e5-4576-a528-d86801f0f9ab None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:23.851582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:23.852442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8058b4c3-52e5-4576-a528-d86801f0f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.922519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 979/1999] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:23.923854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26624-dba9-490f-832f-13e559297a32 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:23.954510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26624-dba9-490f-832f-13e559297a32 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:23.954510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26624-dba9-490f-832f-13e559297a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:23.954510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6dc26624-dba9-490f-832f-13e559297a32 None None] MFA Rules not processed for user `ed284b03216448c8867c350b98015647`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:23.954510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6dc26624-dba9-490f-832f-13e559297a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:23.987583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:23.989111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc4bf068b0748a5b2eed8cbe994e007'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.016123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 980/2000] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:24.017937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.018229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.018551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.037235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:24.038486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.049962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 981/2001] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:24.049962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.052048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.105906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc4bf068b0748a5b2eed8cbe994e007'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.106663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc4bf068b0748a5b2eed8cbe994e007'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.112801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9173-f3b4-478e-a43a-2fda796db47f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.116192 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc4bf068b0748a5b2eed8cbe994e007'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.116668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.117339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.117769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.118062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.127579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.128319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc4bf068b0748a5b2eed8cbe994e007'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.130010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.134905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1021/2002] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:23 2022] DELETE /identity/v3/users/4bc4bf068b0748a5b2eed8cbe994e007 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:24.139003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.140606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.150628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 982/2003] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:24.231427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f9e5-9c54-4bfe-94e5-457d273bb699 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.237164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.237842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.238135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.238441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.239182 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:24.239653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.241314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.254337 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1022/2004] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:24.266448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.277621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917841c6-7c9b-403e-87ee-797fd7ee0567 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.283644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.284282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.284694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.284986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.285717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.288033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.481092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 983/2005] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:24.485730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.496766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6557e-4c44-4c4b-8857-25ed5204f009 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.555434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.556031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.556356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.556635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.557326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.559281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.622225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.623846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.640834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1023/2006] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:24.642469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.650509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735e4c1-9da8-4969-9019-870b99dbfa94 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.656415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c115f0-1268-48b2-8971-8a19d7c88607 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.659088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.659840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.660201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.660547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.660640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.661432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.661551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.661800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.662080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] PATH_INFO: `/v3/projects/1b0129ed0de34865a44b8ddd965e8562` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.663289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0129ed0de34865a44b8ddd965e8562)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.663415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.665193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.674621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1024/2007] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:24.679781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.692300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82edb-ff30-4891-a54d-2eeac2ab24e5 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.697525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.698352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.698661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.699012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.699875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.701584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.714398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1025/2008] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:24.718397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.728158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756680-0576-4792-ae35-9dbd41d17734 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:24.732914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:24.733791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.734061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.734341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] PATH_INFO: `/v3/projects/143caf29a25d47dbb8612d6a622774e3/users/d72a7a3520bd427997650e559215b34e/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.749855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=143caf29a25d47dbb8612d6a622774e3, user_id=d72a7a3520bd427997650e559215b34e, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:24.753114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c788-4f6d-4bcb-aa8c-b39c0978f27d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:24.860883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1026/2009] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:24 2022] PUT /identity/v3/projects/143caf29a25d47dbb8612d6a622774e3/users/d72a7a3520bd427997650e559215b34e/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:24.871144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.871462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.871722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.880837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0129ed0de34865a44b8ddd965e8562', 'request_id': 'req-49f09560-12e8-4702-8329-df39e3e1a089'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.887580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0129ed0de34865a44b8ddd965e8562', 'request_id': 'req-49f09560-12e8-4702-8329-df39e3e1a089'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.896412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0129ed0de34865a44b8ddd965e8562', 'request_id': 'req-49f09560-12e8-4702-8329-df39e3e1a089'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.900999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] MFA Rules not processed for user `d72a7a3520bd427997650e559215b34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:24.902546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.942176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] The token cache is being invalidate because project 1b0129ed0de34865a44b8ddd965e8562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:24.942727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.943661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-49f09560-12e8-4702-8329-df39e3e1a089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:24.948679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 984/2010] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:24 2022] DELETE /identity/v3/projects/1b0129ed0de34865a44b8ddd965e8562 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:24.952265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3e1e-7283-4ed1-a9dc-f47e416ae092 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:24.953055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3e1e-7283-4ed1-a9dc-f47e416ae092 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:24.953300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3e1e-7283-4ed1-a9dc-f47e416ae092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:24.964369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:24.976032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-982e3e1e-7283-4ed1-a9dc-f47e416ae092 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:24.977253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-982e3e1e-7283-4ed1-a9dc-f47e416ae092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:24.980125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1027/2011] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:24.984821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:24.986220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:25.050978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 985/2012] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:25.057805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78e48f-b6e4-40ec-838d-9353f82aa73d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.058752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.059051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.059331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.062916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.064416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.064416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.064635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.065315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.067286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.078145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:25.080710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:25.088865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 986/2013] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:25.095673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.104720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a121dee-daa9-46fb-8c3e-dfd8d2973534 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.109417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.110169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.111086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.111377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.112101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:25.112412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.114016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.124010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.128001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 987/2014] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:25.136954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.147527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec0bb-c961-4c29-b478-ec781746b276 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.152354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.152974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.153254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.153534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.154213 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.156127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.194296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1028/2015] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:24 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:25.198379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.260413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3df4d-842d-435a-9ac3-304da3aef508 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.265253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.265931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.266243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.267479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.267806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.269851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.287799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 988/2016] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:25.288877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.356804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc857f7-67f3-4d18-86ce-b1aa67ca9912 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.364071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.364760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.365049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.365332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.366027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.368020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.372126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1029/2017] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:25.373814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.384517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459b5e8-56cf-4069-a3ef-b7d458760415 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.389620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.390675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.391042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.391555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.392379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.394179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.407483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1030/2018] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:25.408985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.418973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61e46-42a3-4b10-afad-fc0feec44b83 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.424432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.433176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.433176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.433176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] PATH_INFO: `/v3/projects/d39d9fdb28c94457870226524c95a443/users/a2d1bbe640ab45b8a485652b9487d3ad/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.442207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39d9fdb28c94457870226524c95a443, user_id=a2d1bbe640ab45b8a485652b9487d3ad, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.446184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.521342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 989/2019] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:25.521861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1031/2020] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:25 2022] PUT /identity/v3/projects/d39d9fdb28c94457870226524c95a443/users/a2d1bbe640ab45b8a485652b9487d3ad/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:25.522395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.523147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.539212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320ef3-80f4-41f8-9762-e008c0306ac0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.595731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5ad6-69ed-4fbe-b732-a8bc66873391 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.600736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.601573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.601864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.602144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.602652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.602916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.603327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.608702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.608702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.608702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.609014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.609111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.615273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1032/2021] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:25.619380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 990/2022] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:25.620512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.620662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.631148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76355-173f-4736-9255-15f8ecc0c4fd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.633326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a34f95-3b7a-444b-b26c-0aa8c9bad6bc admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.634350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.636144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.636884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.637236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.637580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.638364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.638518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.639503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.639793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.640077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] PATH_INFO: `/v3/projects/d39d9fdb28c94457870226524c95a443/users/a2d1bbe640ab45b8a485652b9487d3ad/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.640399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.643456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39d9fdb28c94457870226524c95a443, user_id=a2d1bbe640ab45b8a485652b9487d3ad, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.649082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fd63b-0a6b-4014-bd6b-6fec69784718 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.651122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 991/2023] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:25.655150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.660995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1033/2024] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:25 2022] PUT /identity/v3/projects/d39d9fdb28c94457870226524c95a443/users/a2d1bbe640ab45b8a485652b9487d3ad/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:25.665753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72122b58-b50e-4326-b8b1-4e686357c27e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.678914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.679207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.679489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.713169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] MFA Rules not processed for user `a2d1bbe640ab45b8a485652b9487d3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:25.714798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:25.725024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.726162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.726477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.727226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] PATH_INFO: `/v3/projects/f57f2e4c9f9d4a3dacf592977fdd6354/users/1dbd51cb21254c72ace37a5c6962a4ae/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.750604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57f2e4c9f9d4a3dacf592977fdd6354, user_id=1dbd51cb21254c72ace37a5c6962a4ae, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:25.753947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff93a-edf8-488a-8f16-d8e83587b8b8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:25.776576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.795487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1034/2025] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:25.811578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:25.815059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:25.826003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 992/2026] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:25 2022] PUT /identity/v3/projects/f57f2e4c9f9d4a3dacf592977fdd6354/users/1dbd51cb21254c72ace37a5c6962a4ae/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:25.834848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.837667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.837959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.838247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.864748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] MFA Rules not processed for user `1dbd51cb21254c72ace37a5c6962a4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:25.866665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:25.876719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76658b5-818a-4a4e-8c54-a5388a1f77fa None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:25.939261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:25.939919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:25.940210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:25.940490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:25.941981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 993/2027] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:25.946422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.012906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.012906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.013086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242c33-874c-42f9-940b-e9fb018c0b2f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.019685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.020359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.020649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.020905 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1035/2028] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:26.021031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.021614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.023647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.121724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 994/2029] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:25 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:26.125002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:26.128059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.140652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0a01c-3170-41c4-b0e4-bbb8d93f4a84 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.204359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:26.230800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.231481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.231764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.232041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.232741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.235744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.329581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1036/2030] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:26 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:26.333458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.343537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aae1d-58b4-4abd-9831-a1fcf102d2d1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.348918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.349572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.349855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.350193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.350958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.352547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.363476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 995/2031] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:26.367535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.378205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c608bd-7351-4230-ad72-ef33d5b009d4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.382858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.383740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.384021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.384303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] PATH_INFO: `/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7/users/a7471e2a6b9647189a4c84ff1336edd6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.400894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2fb2fe8c9c431c8ea35e66486269b7, user_id=a7471e2a6b9647189a4c84ff1336edd6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.403647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.518965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1037/2032] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:26 2022] PUT /identity/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7/users/a7471e2a6b9647189a4c84ff1336edd6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:26.525392 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.533577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1ab-70f0-449c-95ce-13bda82c515d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.597886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.598779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.599073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.599357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.600101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.601784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1c618-b7c5-4640-bfdc-3c67902b1866 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.616593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 996/2033] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:26.619135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.633475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260dbd-69b0-448b-a03f-c0e2c9dfb482 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.637093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.637985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.638269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.638587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] PATH_INFO: `/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7/users/a7471e2a6b9647189a4c84ff1336edd6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.640541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2fb2fe8c9c431c8ea35e66486269b7, user_id=a7471e2a6b9647189a4c84ff1336edd6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.643778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.653991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1038/2034] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:26 2022] PUT /identity/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7/users/a7471e2a6b9647189a4c84ff1336edd6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:26.664920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.665217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.665505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.694674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] MFA Rules not processed for user `a7471e2a6b9647189a4c84ff1336edd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:26.696055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:26.764914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 997/2035] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:26.898874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:26.957064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded2d-728f-43c6-97cc-9d6abe4554c9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:26.960820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:26.961543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:26.961836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:26.962118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:26.972588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:26.974089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:26.984681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1039/2036] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:27.037572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:27.123482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:27.528821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:27.637247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:27.803769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:27.864713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683267ba-deea-4525-9812-42ff050bd6fa None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:27.869174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:27.870063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:27.870346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:27.870652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] PATH_INFO: `/v3/users/d72a7a3520bd427997650e559215b34e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:27.871821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72a7a3520bd427997650e559215b34e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:27.873810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.004922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.013546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aebca6-08e0-4fe8-9f10-eb12b10e15df service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:28.018493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:28.019356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.019640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.019926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] PATH_INFO: `/v3/users/1dbd51cb21254c72ace37a5c6962a4ae` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.021141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbd51cb21254c72ace37a5c6962a4ae)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:28.023119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.122050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72a7a3520bd427997650e559215b34e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.122736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72a7a3520bd427997650e559215b34e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.137705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:28.219632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72a7a3520bd427997650e559215b34e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.220264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72a7a3520bd427997650e559215b34e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.233028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72a7a3520bd427997650e559215b34e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.243337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:28.255438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 998/2037] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:27 2022] DELETE /identity/v3/users/d72a7a3520bd427997650e559215b34e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:28.255438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.255438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.260523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbd51cb21254c72ace37a5c6962a4ae'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.314206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7da6f-9227-4e38-bc76-e8af754ce7fb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:28.317743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:28.318454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.318747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.319123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.320865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.379683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbd51cb21254c72ace37a5c6962a4ae'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.380302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbd51cb21254c72ace37a5c6962a4ae'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.384927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:28.386575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d96482-8daf-4d96-b281-77e70838a680 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.387774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbd51cb21254c72ace37a5c6962a4ae'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.396848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 999/2038] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:28.398122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86dd1-138e-4ddb-9329-58e82c62dea3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.398434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86dd1-138e-4ddb-9329-58e82c62dea3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.398720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86dd1-138e-4ddb-9329-58e82c62dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.400510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbd51cb21254c72ace37a5c6962a4ae'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.411847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1040/2039] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:28 2022] DELETE /identity/v3/users/1dbd51cb21254c72ace37a5c6962a4ae => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:28.413541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.414003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.420284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b3e86dd1-138e-4ddb-9329-58e82c62dea3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:28.423048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b3e86dd1-138e-4ddb-9329-58e82c62dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.497004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1000/2040] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:28.498345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6db56-0615-4bb2-a8f4-7143c86839a1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:28.502527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.502925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.503301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.506015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:28.507031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.507319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.507597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] PATH_INFO: `/v3/users/982df18bcfd1454b84db7f705f4d5cdd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.508806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982df18bcfd1454b84db7f705f4d5cdd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:28.511179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.525782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:28.527046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.537202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1001/2041] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:28.537841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.539491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.598165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9896-5f9c-491e-88de-a68f57c5b578 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:28.601850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:28.602530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.602853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.603168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.612558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:28.613995 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.631776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1002/2042] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:28.632737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.646861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b029-9940-4b7e-8797-3c15a3c37f47 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:28.651615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:28.652426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.652796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.653296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.665755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:28.667296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430595e-9def-4dfb-9e30-b4d2416391c5 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:28.678085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1003/2043] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:28.689112 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:28.694386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982df18bcfd1454b84db7f705f4d5cdd'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.752515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:28.808002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982df18bcfd1454b84db7f705f4d5cdd'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.808682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982df18bcfd1454b84db7f705f4d5cdd'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.817301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982df18bcfd1454b84db7f705f4d5cdd'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.834348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982df18bcfd1454b84db7f705f4d5cdd'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:28.840803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1041/2044] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:28 2022] DELETE /identity/v3/users/982df18bcfd1454b84db7f705f4d5cdd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:28.845634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:28.845927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:28.846205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:28.864352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:28.865578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:28.935869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1004/2045] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:28.954481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:28.957295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.083975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0f12-789f-495f-ac91-0fde194c8be7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:29.092031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:29.092941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:29.093229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:29.093511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:29.111131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:29.114904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:29.130587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1042/2046] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:29.290816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:29.292265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.306081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab20cb-8a5c-4310-a49c-08d53eaaea0c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:29.311060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:29.311934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:29.312223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:29.312504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] PATH_INFO: `/v3/projects/143caf29a25d47dbb8612d6a622774e3` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:29.313961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143caf29a25d47dbb8612d6a622774e3)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:29.315999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:29.333566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:29.335065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.350835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a556-4e0c-41f3-9b11-7dac57e648c2 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:29.356424 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:29.358133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:29.363254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:29.363254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] PATH_INFO: `/v3/projects/f57f2e4c9f9d4a3dacf592977fdd6354` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:29.363254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57f2e4c9f9d4a3dacf592977fdd6354)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:29.364706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:29.461219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:29.482326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57f2e4c9f9d4a3dacf592977fdd6354', 'request_id': 'req-b0d6543b-4b54-421b-9325-68ec458a0761'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.482534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143caf29a25d47dbb8612d6a622774e3', 'request_id': 'req-9593642d-0b46-48c2-a779-fba82d3ce033'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.488853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143caf29a25d47dbb8612d6a622774e3', 'request_id': 'req-9593642d-0b46-48c2-a779-fba82d3ce033'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.496993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143caf29a25d47dbb8612d6a622774e3', 'request_id': 'req-9593642d-0b46-48c2-a779-fba82d3ce033'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.551133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57f2e4c9f9d4a3dacf592977fdd6354', 'request_id': 'req-b0d6543b-4b54-421b-9325-68ec458a0761'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.557104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57f2e4c9f9d4a3dacf592977fdd6354', 'request_id': 'req-b0d6543b-4b54-421b-9325-68ec458a0761'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.568843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] The token cache is being invalidate because project f57f2e4c9f9d4a3dacf592977fdd6354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:29.569131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.569795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.571365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1043/2047] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:29 2022] DELETE /identity/v3/projects/f57f2e4c9f9d4a3dacf592977fdd6354 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:29.575174 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:29.576614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.640989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6543b-4b54-421b-9325-68ec458a0761 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:29.646301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:29.647825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:29.648528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:29.648528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] PATH_INFO: `/v3/users/a7471e2a6b9647189a4c84ff1336edd6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:29.649583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7471e2a6b9647189a4c84ff1336edd6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:29.653884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:29.655572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] The token cache is being invalidate because project 143caf29a25d47dbb8612d6a622774e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:29.656009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.657510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.660072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1005/2048] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:29 2022] DELETE /identity/v3/projects/143caf29a25d47dbb8612d6a622774e3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:29.661015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:29.666712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.728435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593642d-0b46-48c2-a779-fba82d3ce033 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:29.733220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:29.734096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:29.734376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:29.734688 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] PATH_INFO: `/v3/projects/50fe6cc5a5a5404689db56d75bc6e1e9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:29.737113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fe6cc5a5a5404689db56d75bc6e1e9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:29.739074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:29.839708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7471e2a6b9647189a4c84ff1336edd6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.854798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fe6cc5a5a5404689db56d75bc6e1e9', 'request_id': 'req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.861176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fe6cc5a5a5404689db56d75bc6e1e9', 'request_id': 'req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.868243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fe6cc5a5a5404689db56d75bc6e1e9', 'request_id': 'req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.933713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7471e2a6b9647189a4c84ff1336edd6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.934364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7471e2a6b9647189a4c84ff1336edd6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.945801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:29.945991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7471e2a6b9647189a4c84ff1336edd6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.958694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7471e2a6b9647189a4c84ff1336edd6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:29.964872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1044/2049] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:29 2022] DELETE /identity/v3/users/a7471e2a6b9647189a4c84ff1336edd6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:29.973803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:29.973803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:29.997074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] The token cache is being invalidate because project 50fe6cc5a5a5404689db56d75bc6e1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:30.002301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.002301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.002301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1006/2050] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:29 2022] DELETE /identity/v3/projects/50fe6cc5a5a5404689db56d75bc6e1e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:30.004009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:30.005402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:30.033837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ade1b-7cd5-4d72-91ba-b6c1647f3d88 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:30.039181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:30.040061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:30.040350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:30.040713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] PATH_INFO: `/v3/users/a2d1bbe640ab45b8a485652b9487d3ad` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:30.041946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d1bbe640ab45b8a485652b9487d3ad)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:30.044006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:30.076032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288cb5-508f-42cf-8b0d-29f0633a7f4f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:30.081061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:30.081914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:30.082205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:30.082540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] PATH_INFO: `/v3/users/1fbeeb1bcb3e4de4a3be2ca0ad5af719` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:30.083782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbeeb1bcb3e4de4a3be2ca0ad5af719)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:30.085736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:30.273379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d1bbe640ab45b8a485652b9487d3ad'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.339831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d1bbe640ab45b8a485652b9487d3ad'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.340487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d1bbe640ab45b8a485652b9487d3ad'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.348584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d1bbe640ab45b8a485652b9487d3ad'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.355104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbeeb1bcb3e4de4a3be2ca0ad5af719'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.355786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbeeb1bcb3e4de4a3be2ca0ad5af719'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.361912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d1bbe640ab45b8a485652b9487d3ad'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.368102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1045/2051] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:29 2022] DELETE /identity/v3/users/a2d1bbe640ab45b8a485652b9487d3ad => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:30.431274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbeeb1bcb3e4de4a3be2ca0ad5af719'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.431972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbeeb1bcb3e4de4a3be2ca0ad5af719'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.446018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6ab22749-5d34-4663-9032-206a19a3bbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbeeb1bcb3e4de4a3be2ca0ad5af719'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.458738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1007/2052] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:30 2022] DELETE /identity/v3/users/1fbeeb1bcb3e4de4a3be2ca0ad5af719 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:30.566363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:30.567915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:30.660561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c43e9-88f6-4f10-96c9-18c03a76d04f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:30.691504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:30.716089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:30.716972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:30.717252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:30.717523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] PATH_INFO: `/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:30.718711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2fb2fe8c9c431c8ea35e66486269b7)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:30.720695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:30.798020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:30.861405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2fb2fe8c9c431c8ea35e66486269b7', 'request_id': 'req-641b1344-8d86-4522-b49c-fbeecf795a1b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.923344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2fb2fe8c9c431c8ea35e66486269b7', 'request_id': 'req-641b1344-8d86-4522-b49c-fbeecf795a1b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.930028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2fb2fe8c9c431c8ea35e66486269b7', 'request_id': 'req-641b1344-8d86-4522-b49c-fbeecf795a1b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.942716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] The token cache is being invalidate because project cd2fb2fe8c9c431c8ea35e66486269b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:30.943093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.943701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:30.945390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1046/2053] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:30 2022] DELETE /identity/v3/projects/cd2fb2fe8c9c431c8ea35e66486269b7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:30.950459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e44e-c495-4f10-ac85-4f281f40be85 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:30.950940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e44e-c495-4f10-ac85-4f281f40be85 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:30.951224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e44e-c495-4f10-ac85-4f281f40be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:30.970425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1b52e44e-c495-4f10-ac85-4f281f40be85 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:30.971684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1b52e44e-c495-4f10-ac85-4f281f40be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.033008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.034122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1008/2054] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:31.036035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.042813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.043678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.043972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.055521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1344-8d86-4522-b49c-fbeecf795a1b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.060414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.061284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.061646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.061956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] PATH_INFO: `/v3/projects/79a844e995824fed901ae5b7eddea450` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.063824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a844e995824fed901ae5b7eddea450)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.065767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.066709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:31.068002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.076422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1009/2055] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:31.081339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.091340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c173f0-d250-4ce4-b1b4-9d212ceeccdc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.097469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.098306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.098614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.098897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.100447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:31.100447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.101788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.117604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1010/2056] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:31.120309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.122140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.137173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfd35-af13-4eea-8e60-afdd98862aea admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.142171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.143091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.143370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.143652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] PATH_INFO: `/v3/projects/d39d9fdb28c94457870226524c95a443` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.144855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39d9fdb28c94457870226524c95a443)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.146859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.171382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a844e995824fed901ae5b7eddea450', 'request_id': 'req-714a615e-3e97-4196-a7c6-97c6049099ba'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.220434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a844e995824fed901ae5b7eddea450', 'request_id': 'req-714a615e-3e97-4196-a7c6-97c6049099ba'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.227087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a844e995824fed901ae5b7eddea450', 'request_id': 'req-714a615e-3e97-4196-a7c6-97c6049099ba'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.240382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] The token cache is being invalidate because project 79a844e995824fed901ae5b7eddea450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:31.240745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.241486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39d9fdb28c94457870226524c95a443', 'request_id': 'req-a4afcefe-5b1e-4758-9439-391696419ce6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.242493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.247307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1047/2057] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:31 2022] DELETE /identity/v3/projects/79a844e995824fed901ae5b7eddea450 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:31.247307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.247307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.249733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39d9fdb28c94457870226524c95a443', 'request_id': 'req-a4afcefe-5b1e-4758-9439-391696419ce6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.257992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39d9fdb28c94457870226524c95a443', 'request_id': 'req-a4afcefe-5b1e-4758-9439-391696419ce6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.325755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a615e-3e97-4196-a7c6-97c6049099ba admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.345894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] The token cache is being invalidate because project d39d9fdb28c94457870226524c95a443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:31.348241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.348241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.350628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1011/2058] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:31 2022] DELETE /identity/v3/projects/d39d9fdb28c94457870226524c95a443 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:31.351650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.353134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.355766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:31.394264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.394979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.395302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.395587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.396356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.398284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570db081-0fa0-4c5e-896d-a64b9f0ee1f2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.432609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afcefe-5b1e-4758-9439-391696419ce6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.437634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.438656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.438946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.439227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] PATH_INFO: `/v3/users/15ee4a1b06374d729791ad6757322caf` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.440457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ee4a1b06374d729791ad6757322caf)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.442396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.487402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1048/2059] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:31.487402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.487402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.487402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.508077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:31.509283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.566971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1049/2060] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:31.567784 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.569062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.581068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da543db-9769-49b6-b07f-1f9f8aa6e5f6 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.585746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.586404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.586731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.587010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.587701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.589668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c272e-3231-4a78-966b-de1fdc0e9f34 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.640124 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ee4a1b06374d729791ad6757322caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.641463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ee4a1b06374d729791ad6757322caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.705960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ee4a1b06374d729791ad6757322caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.706666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ee4a1b06374d729791ad6757322caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.713473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1050/2061] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:31.717774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.718088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.718380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.721896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ee4a1b06374d729791ad6757322caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:31.735178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1012/2062] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:31 2022] DELETE /identity/v3/users/15ee4a1b06374d729791ad6757322caf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:31.736211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.737572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.743090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:31.744284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.810996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc505-c11d-4460-bd63-f2b61a8f6488 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.813983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1051/2063] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:31.815001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.816429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:31.820109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.822048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.822875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.823597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] PATH_INFO: `/v3/users/ed284b03216448c8867c350b98015647` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.825666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed284b03216448c8867c350b98015647)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.828256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.832167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50042a1a-008f-4109-8de0-ee0cb75e8048 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.837841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.838645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.838882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.839104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.840168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.842887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.859276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1052/2064] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:31.859276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.869387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411aa03-d904-48b1-ab38-a55b08c8ad75 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.874488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.875735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.876091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.876824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.877074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:31.877387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.879107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.882718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:31.892111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1053/2065] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:31.893835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.902529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0789a3-6eef-4c45-80e9-71a869fa7807 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.907393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.908055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.908345 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.908628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.909388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.911026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:31.921170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1054/2066] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:31.921947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:31.931615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a6a8-c80d-458a-a849-6aa401274592 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:31.936258 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:31.936885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:31.937171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:31.937451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:31.938697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:31.940575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.071755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1055/2067] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:31 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:32.071755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.109333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed284b03216448c8867c350b98015647'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.111513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed284b03216448c8867c350b98015647'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.137688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faed9-9c75-40d1-8ecf-244d534c729d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.143305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.144226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.144514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.144793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] PATH_INFO: `/v3/projects/fa2a4f3201ba474490b2876610d4fded/users/31dfefdd4b344e0ba22b0a4d5e8b0a40/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.160302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2a4f3201ba474490b2876610d4fded, user_id=31dfefdd4b344e0ba22b0a4d5e8b0a40, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.163010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.201904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed284b03216448c8867c350b98015647'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.202596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed284b03216448c8867c350b98015647'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.216751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed284b03216448c8867c350b98015647'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.231609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1013/2068] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:31 2022] DELETE /identity/v3/users/ed284b03216448c8867c350b98015647 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:32.234968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.235150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.253380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1056/2069] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:32 2022] PUT /identity/v3/projects/fa2a4f3201ba474490b2876610d4fded/users/31dfefdd4b344e0ba22b0a4d5e8b0a40/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:32.253380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.254930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.304517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1ebb-b735-4a2f-a279-417c59cbe21f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.322448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4faad-76b0-46f6-9814-6ace95802ebf admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.327215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.328080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.328877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.329601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] PATH_INFO: `/v3/projects/4fdea3199a0b419ea99602bb0ac67936` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.330342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdea3199a0b419ea99602bb0ac67936)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.332286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.361312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.362027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.362313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.362621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.363307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.365313 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3a7b2-a0aa-43b2-a3ce-1e98ba1e7ff1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.493020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdea3199a0b419ea99602bb0ac67936', 'request_id': 'req-16de7483-51ba-4b8f-87f3-3a354e037a03'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.501037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1014/2070] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/users => generated 279 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:32.502364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8eb3-1fdc-489e-990d-f6ff57ee8512 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.502981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8eb3-1fdc-489e-990d-f6ff57ee8512 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.503160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8eb3-1fdc-489e-990d-f6ff57ee8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.521047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c11b8eb3-1fdc-489e-990d-f6ff57ee8512 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:32.522281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c11b8eb3-1fdc-489e-990d-f6ff57ee8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.579872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdea3199a0b419ea99602bb0ac67936', 'request_id': 'req-16de7483-51ba-4b8f-87f3-3a354e037a03'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.587116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdea3199a0b419ea99602bb0ac67936', 'request_id': 'req-16de7483-51ba-4b8f-87f3-3a354e037a03'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.591548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1015/2071] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:32.591548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb1fa-f05e-4703-b81a-ab80aa6f26dc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.591548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb1fa-f05e-4703-b81a-ab80aa6f26dc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.591548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb1fa-f05e-4703-b81a-ab80aa6f26dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.601890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] The token cache is being invalidate because project 4fdea3199a0b419ea99602bb0ac67936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:32.602286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.603089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:32.604782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1057/2072] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:32 2022] DELETE /identity/v3/projects/4fdea3199a0b419ea99602bb0ac67936 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:32.605811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.607244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.622306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de7483-51ba-4b8f-87f3-3a354e037a03 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.626572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e8acb1fa-f05e-4703-b81a-ab80aa6f26dc None None] MFA Rules not processed for user `31dfefdd4b344e0ba22b0a4d5e8b0a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:32.627827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e8acb1fa-f05e-4703-b81a-ab80aa6f26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.629348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.630331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.630790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.631213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.638690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.640443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.651721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1058/2073] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:32.652742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.656225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.707633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1016/2074] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:32.708804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.709105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.709575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.717285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:32.733677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:32.733912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af898-db4d-48e3-85e9-af7562d6390f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.735769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.738964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.739625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.739933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.740194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.742028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.745615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1017/2075] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:32.746298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.756337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de277bc7-88eb-476c-85f8-f97aefa39ec3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.761242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.762181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.762854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.763597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.763938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.764575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.765409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.767623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e6d4c-3cc2-4560-9ef9-d0e7d712a921 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.774912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1059/2076] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:32.775553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.777680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.785105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1018/2077] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:32.787866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.791006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.791006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.791768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326bb5-391e-4253-ba99-36daacb42fa9 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.796825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.798084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.798375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.798688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.799994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.802205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.822680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:32.824590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:32.834400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1019/2078] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:32.835559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.837314 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:32.848448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5562f-ea19-489e-9048-28a1bd638357 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:32.853187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:32.854254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:32.854430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:32.854718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] PATH_INFO: `/v3/projects/6d28898e8ea9499bbbc70558ad4b945d/users/c346c25250bb41f9b5fe30173914f452/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:32.870484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d28898e8ea9499bbbc70558ad4b945d, user_id=c346c25250bb41f9b5fe30173914f452, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:32.873324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:32.911206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1060/2079] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:32.911206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.941469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1020/2080] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:32 2022] PUT /identity/v3/projects/6d28898e8ea9499bbbc70558ad4b945d/users/c346c25250bb41f9b5fe30173914f452/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:32.942949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:32.992848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5554-20dd-4a2b-8348-48df0fca34e4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.014062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6065-48a6-4995-b9aa-40fbe9228ccc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.029164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.030226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.030591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.030934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.032375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.035219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.058391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.059346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.059783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.060088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.060825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:33.061138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.062826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b97e71-7f28-4aaa-afb8-e9799de00cb9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.075280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1061/2081] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:33.076920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.077219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.077503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.104591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] MFA Rules not processed for user `c346c25250bb41f9b5fe30173914f452`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:33.105819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.139055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1021/2082] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:32 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:33.139055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.150934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da34aa2-9fdf-4de1-8cfa-3bbd8932ae94 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.159841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d125376-072b-4928-9218-806259623b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.159841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d125376-072b-4928-9218-806259623b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.159841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d125376-072b-4928-9218-806259623b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.159841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d125376-072b-4928-9218-806259623b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.160417 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d125376-072b-4928-9218-806259623b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.162003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d125376-072b-4928-9218-806259623b41 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.178014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1062/2083] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:33.180666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.193525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9982-d781-4e04-876b-5a77b20772e2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.198307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.199002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.199284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.199560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.200274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.201841 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.212366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1063/2084] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:33.213126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.223461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7c713-c910-48f9-996e-0fdce7953b80 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.227987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.228587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.228877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.229150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.229816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.231687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.273994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1022/2085] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:33.274581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d125376-072b-4928-9218-806259623b41 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.321994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1064/2086] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:33.321994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.323613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.347365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d125376-072b-4928-9218-806259623b41 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.393336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d87c2-3e8a-4190-bc7d-8d49a249cc25 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.398161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.399060 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.399367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.399642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] PATH_INFO: `/v3/projects/6108723e646b4d2e83096b3052b855c7` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.400921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6108723e646b4d2e83096b3052b855c7)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.403666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.403931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.404855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.405217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.405412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] PATH_INFO: `/v3/projects/6e50194862f947e79e6c20975fe470dd/users/43278d48926a4adb9c7a83c7c468137b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.420966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e50194862f947e79e6c20975fe470dd, user_id=43278d48926a4adb9c7a83c7c468137b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.425135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.519797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:33.525798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1023/2087] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:33 2022] PUT /identity/v3/projects/6e50194862f947e79e6c20975fe470dd/users/43278d48926a4adb9c7a83c7c468137b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:33.529506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.535708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6108723e646b4d2e83096b3052b855c7', 'request_id': 'req-71fd3503-4e80-4463-84e0-4ebb7df35e25'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:33.590916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d2e2-0fa2-4541-8e06-5d3c873f9f3e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.620189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6108723e646b4d2e83096b3052b855c7', 'request_id': 'req-71fd3503-4e80-4463-84e0-4ebb7df35e25'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:33.628042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6108723e646b4d2e83096b3052b855c7', 'request_id': 'req-71fd3503-4e80-4463-84e0-4ebb7df35e25'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:33.639477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] The token cache is being invalidate because project 6108723e646b4d2e83096b3052b855c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:33.639860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:33.640532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:33.642283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1065/2088] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:33 2022] DELETE /identity/v3/projects/6108723e646b4d2e83096b3052b855c7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:33.643084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.644486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.649328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.650011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.650880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.650880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.651776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.653733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.657533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd3503-4e80-4463-84e0-4ebb7df35e25 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.662155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.662877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.663161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.663444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.664125 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.666029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.722641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:33.731183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1024/2089] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:33.731183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.731183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.742649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c680bd-9610-47bf-bf4e-cae9539fc5a5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.747291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.747956 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.748244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.748527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.749238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.751308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e27e-c60f-4791-aa5f-62c2216e4d9d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.764350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1025/2090] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:33.764517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1066/2091] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:33.764599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.764599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.764599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.766255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.766676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.778834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce10c4-3dc4-49db-92ce-635d4e8db284 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.784062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:33.784296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.784973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.785277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.785743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.786062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.786460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.788058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.795770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1026/2092] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:33.796725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.807898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1067/2093] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:33.807898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.808172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f326da-fec0-4b11-84ec-dc7842785176 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.812130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.813024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.813312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.814295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] PATH_INFO: `/v3/projects/6e50194862f947e79e6c20975fe470dd/users/43278d48926a4adb9c7a83c7c468137b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.816363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e50194862f947e79e6c20975fe470dd, user_id=43278d48926a4adb9c7a83c7c468137b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.818597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6a33-f704-47de-820e-f61a5c5246a9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.819722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f971b-33bf-456b-8ed9-233100b931c6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.823277 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.823938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.824224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.824507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.825227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.826862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.831701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1027/2094] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:33 2022] PUT /identity/v3/projects/6e50194862f947e79e6c20975fe470dd/users/43278d48926a4adb9c7a83c7c468137b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:33.832669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c9ae-c23b-4aa6-a1de-409dfeb94c11 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.833324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c9ae-c23b-4aa6-a1de-409dfeb94c11 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.833324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c9ae-c23b-4aa6-a1de-409dfeb94c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.840408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1068/2095] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:33.841279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.854114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51bab-8ad3-4de4-8005-86b328149503 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.854968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bd38c9ae-c23b-4aa6-a1de-409dfeb94c11 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:33.856189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bd38c9ae-c23b-4aa6-a1de-409dfeb94c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.928580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1028/2096] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:33.929634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.930432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.930773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.930878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.931062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.931337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.931657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.932473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.934101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:33.946939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1069/2097] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:33.947731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:33.959079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc82235-7808-4447-9e23-506e8b9007e9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:33.962446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] MFA Rules not processed for user `43278d48926a4adb9c7a83c7c468137b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:33.964053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:33.974369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:33.975308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:33.975591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:33.975867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] PATH_INFO: `/v3/projects/d54fe7377ac345f795a6930a011ee7f3/users/77afae55bfa54a35ab4f3d5863f9a57a/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:33.994785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54fe7377ac345f795a6930a011ee7f3, user_id=77afae55bfa54a35ab4f3d5863f9a57a, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:33.997999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.051115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1029/2098] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:34.052329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.062129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded8b3-e512-4993-b0d0-89f9bf7ef92e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.068519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.069347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.069691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.070028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.070923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:34.071289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.071611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1070/2099] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:33 2022] PUT /identity/v3/projects/d54fe7377ac345f795a6930a011ee7f3/users/77afae55bfa54a35ab4f3d5863f9a57a/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:34.072356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.074177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.089823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1030/2100] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:34.090698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.092398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.136541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:34.140204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436a81-9d99-48de-b561-5ac0f4040cc8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.145305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.146204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.146521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.146802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] PATH_INFO: `/v3/projects/fa3aec8abfae4d17a3155badc42b4780/users/f51fcc2493544ba381fe05c979302c04/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.150165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2f339-4741-4567-ad22-fd6b522a422f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.162275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3aec8abfae4d17a3155badc42b4780, user_id=f51fcc2493544ba381fe05c979302c04, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.164995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.177235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:34.208442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.209101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.209386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.209700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.211576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.231485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1071/2101] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:34 2022] PUT /identity/v3/projects/fa3aec8abfae4d17a3155badc42b4780/users/f51fcc2493544ba381fe05c979302c04/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:34.232395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.275722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.277333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.288161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1031/2102] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:34.288969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.299875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9efb-35eb-4e80-b86c-9f6a764046b2 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.308910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.309041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964e4-867f-4bac-b9b1-5f8e1b679aec admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.309186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.309186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.309186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.309186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.309565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd383e26-81f4-49aa-a4df-e56939b4c512 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.311387 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.312160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.312700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.312984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.313752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.315395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb76540-e43a-48e7-a8e0-ae6ca4f10420 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.326120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1072/2103] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:34.327629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.327927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.328778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.349117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:34.350513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.358752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1073/2104] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:34.360074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.370075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf338b-728a-4c74-b692-4e1c8146df77 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.374940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.375890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.376177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.376458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] PATH_INFO: `/v3/projects/d54fe7377ac345f795a6930a011ee7f3/users/77afae55bfa54a35ab4f3d5863f9a57a/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.378508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54fe7377ac345f795a6930a011ee7f3, user_id=77afae55bfa54a35ab4f3d5863f9a57a, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.381176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.392726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1074/2105] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:34 2022] PUT /identity/v3/projects/d54fe7377ac345f795a6930a011ee7f3/users/77afae55bfa54a35ab4f3d5863f9a57a/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:34.394083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.402089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1032/2106] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:34 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:34.405447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.405447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.405447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.405686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.420942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:34.433910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] MFA Rules not processed for user `77afae55bfa54a35ab4f3d5863f9a57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:34.435140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.479966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d2a2b-310b-4b14-99b8-4537bbf709db admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.512271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1033/2107] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:34.513614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.537697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.538641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.538928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.539274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.559133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:34.586023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e1e62-5d99-4e0b-b1ba-3b71c0d2f12f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.592373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.593075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.593350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.593629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.594576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.596719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.607163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.608682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.619166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1075/2108] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:34.620076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.621495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:34.665463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1034/2109] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:34 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:34.670205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.681566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a74-e463-4abf-8b14-cc71452fc5be service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.683066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0c783-ecb4-4eaf-b7a0-b28cd25c9719 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.686992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.689081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.689227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.689335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.689335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.689475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.689475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.689699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.690373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.692081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.698745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.700190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.702450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1035/2110] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:34.707177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.711500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1076/2111] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:34.719802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c65e9-7259-495c-8272-8db4c68bfc80 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.724286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.724965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.725254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.725537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.726270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.727931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94032-4507-4efe-931d-a0d24d41fb86 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.739277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1036/2112] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:34.743578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:34.754642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fafb-502f-4943-b0d1-dd5be2fdde8b service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:34.759255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:34.760169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.760456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.760734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] PATH_INFO: `/v3/projects/b878b750ba174ad696122e0748d7ec96/users/27dd159210d84e0bb364f23d34c99566/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.776414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b878b750ba174ad696122e0748d7ec96, user_id=27dd159210d84e0bb364f23d34c99566, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:34.779085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:34.848409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:34.923889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1077/2113] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:34 2022] PUT /identity/v3/projects/b878b750ba174ad696122e0748d7ec96/users/27dd159210d84e0bb364f23d34c99566/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:34.935468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:34.935953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:34.936044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:34.985722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:35.001573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] MFA Rules not processed for user `27dd159210d84e0bb364f23d34c99566`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:35.002893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:35.065650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4199d10-7ec2-4483-8c26-20571cd0ceb4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:35.071070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:35.071926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:35.072385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:35.072855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:35.075298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:35.115020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1037/2114] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:35.125958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:35.136041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0086ab-9504-458f-91fc-55ebfa31b70e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:35.141508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:35.142305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:35.142625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:35.142903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:35.153195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:35.155504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:35.161638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:35.163243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31e8c0-676c-411a-9f99-54288250e3b7 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:35.168534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1038/2115] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:35.180375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1078/2116] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:35.284215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:35.583993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:35.585482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:35.660476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8cb89-bc2d-4e7e-89a3-eb7a8798ffea service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:35.665278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:35.666148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:35.666457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:35.666738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] PATH_INFO: `/v3/users/ba5f299830fe4f6a97be16065aed63c2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:35.667930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5f299830fe4f6a97be16065aed63c2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:35.669957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:35.834214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5f299830fe4f6a97be16065aed63c2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:35.835148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5f299830fe4f6a97be16065aed63c2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:35.894257 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:35.909998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5f299830fe4f6a97be16065aed63c2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:35.910813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5f299830fe4f6a97be16065aed63c2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:35.924983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e5f3fd86-cf56-478d-b5ac-9f51e459a4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5f299830fe4f6a97be16065aed63c2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:35.937549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1039/2117] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:35 2022] DELETE /identity/v3/users/ba5f299830fe4f6a97be16065aed63c2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:35.942219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:35.942707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:35.943091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:35.964138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:35.965497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.009513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:36.009879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:36.010221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:36.035144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1079/2118] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:36.042723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] MFA Rules not processed for user `f51fcc2493544ba381fe05c979302c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:36.044845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.051732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:36.059794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.129630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1040/2119] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:36.130924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:36.132476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.134059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2b1c-7da5-4f18-ab25-c9bd652b0514 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:36.138162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:36.141252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:36.141252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:36.141252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:36.149986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:36.151468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:36.162332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1080/2120] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:36.168053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:36.169839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.195322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f63c-afc1-4f4a-af71-da4b9a5403c5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:36.199380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:36.200105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:36.200714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:36.200714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:36.202700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.238397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c305-3b75-4f98-b912-2ff951f18b87 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:36.242941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:36.243732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:36.244117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:36.244507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:36.267789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:36.267789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:36.278601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1081/2121] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:36.287942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:36.289481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:36.300662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1041/2122] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:36.420358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:36.677573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:36.679103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:36.713509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d8d-9987-4e1e-9b23-c2794ec3d192 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:36.718191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759df62c-00b9-444b-b500-25949605506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:36.719696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759df62c-00b9-444b-b500-25949605506e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:36.719983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759df62c-00b9-444b-b500-25949605506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:36.720259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759df62c-00b9-444b-b500-25949605506e admin admin] PATH_INFO: `/v3/projects/e09ba6e232ae4841a5ea4f162bef7cea` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:36.721493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759df62c-00b9-444b-b500-25949605506e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09ba6e232ae4841a5ea4f162bef7cea)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:36.723453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759df62c-00b9-444b-b500-25949605506e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:36.869921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09ba6e232ae4841a5ea4f162bef7cea', 'request_id': 'req-759df62c-00b9-444b-b500-25949605506e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:36.991439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09ba6e232ae4841a5ea4f162bef7cea', 'request_id': 'req-759df62c-00b9-444b-b500-25949605506e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:36.998352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09ba6e232ae4841a5ea4f162bef7cea', 'request_id': 'req-759df62c-00b9-444b-b500-25949605506e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.012084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] The token cache is being invalidate because project e09ba6e232ae4841a5ea4f162bef7cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:37.012377 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.013032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.018547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1082/2123] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:36 2022] DELETE /identity/v3/projects/e09ba6e232ae4841a5ea4f162bef7cea => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:37.020467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:37.033896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46cb54-6692-47fa-ad67-9dc5daf14fc2 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:37.092810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:37.093719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:37.094006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:37.094279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] PATH_INFO: `/v3/users/947b21e19bcb436fa75e8932bdb30fda` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:37.095606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947b21e19bcb436fa75e8932bdb30fda)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:37.097525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:37.185228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.302949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947b21e19bcb436fa75e8932bdb30fda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.303687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947b21e19bcb436fa75e8932bdb30fda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.373784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947b21e19bcb436fa75e8932bdb30fda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.374474 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947b21e19bcb436fa75e8932bdb30fda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.387827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2146cf86-a142-4d8e-b6c1-29cd92013fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947b21e19bcb436fa75e8932bdb30fda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:37.400543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1042/2124] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:37 2022] DELETE /identity/v3/users/947b21e19bcb436fa75e8932bdb30fda => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:37.540095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.803002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.883829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:37.885384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:37.902357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759df62c-00b9-444b-b500-25949605506e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:37.962146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:37.963073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:37.963355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:37.963630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] PATH_INFO: `/v3/projects/50e1a3d522614552ac3ef41b4d455659` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:37.964797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e1a3d522614552ac3ef41b4d455659)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:37.966762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:37.999333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:38.108259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e1a3d522614552ac3ef41b4d455659', 'request_id': 'req-46ead21b-5050-4144-903d-4fddc3c113d8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:38.196331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e1a3d522614552ac3ef41b4d455659', 'request_id': 'req-46ead21b-5050-4144-903d-4fddc3c113d8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:38.203485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e1a3d522614552ac3ef41b4d455659', 'request_id': 'req-46ead21b-5050-4144-903d-4fddc3c113d8'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:38.215916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] The token cache is being invalidate because project 50e1a3d522614552ac3ef41b4d455659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:38.216103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:38.216799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-46ead21b-5050-4144-903d-4fddc3c113d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:38.220418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1083/2125] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:37 2022] DELETE /identity/v3/projects/50e1a3d522614552ac3ef41b4d455659 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:38.229492 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af553-efaf-4dac-8578-2bb38b15dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.230258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af553-efaf-4dac-8578-2bb38b15dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.231619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af553-efaf-4dac-8578-2bb38b15dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.251936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4f9af553-efaf-4dac-8578-2bb38b15dcf0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:38.253402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4f9af553-efaf-4dac-8578-2bb38b15dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:38.292696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.293104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.293620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.322927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1043/2126] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:38.323593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] MFA Rules not processed for user `f51fcc2493544ba381fe05c979302c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:38.324864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:38.332965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.333253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.333698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.361882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:38.363168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:38.371413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1044/2127] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:38.376297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.386228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280439b2-f48d-4222-a1ea-555f6f9b575e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.398528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1084/2128] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:38.398638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.398638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.398638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.398638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.399059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:38.399059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.399059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:38.408629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1045/2129] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:38.412946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.425325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131f9a6-9b4d-4a47-b1a5-5c2cb714cdc8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.430346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.431019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.431305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.431588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.432281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.434324 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:38.506472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1085/2130] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:38 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:38.510847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.522266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d4d6-67e6-4a94-a9a1-1c3d91f3dac6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.522730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:38.584551 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.585653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.585949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.586233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.586961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.589115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:38.604525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:38.714263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1046/2131] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:38 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:38.720810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.740243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba037-44f4-45c6-ba27-d2b92b68a136 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.746009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.747504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.747931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.748356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.749420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.752465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:38.771595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1086/2132] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:38.775683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.788210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896fe7-fc89-4594-9aec-3e34d8ab2ba3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.792979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.793650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.793933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.794259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.795035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.797322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2da051-c93c-4533-9ada-8fc1adc0a563 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:38.831809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1047/2133] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:38.835212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:38.848663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f5c49-0c32-4985-9165-45efaf86070e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:38.855797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:38.856756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:38.857044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:38.861719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] PATH_INFO: `/v3/projects/279b177b69384d73970e965046469e67/users/52b82ef827204a09adc06d232e7489a1/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:38.874805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279b177b69384d73970e965046469e67, user_id=52b82ef827204a09adc06d232e7489a1, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:38.877873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:39.021059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1087/2134] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:38 2022] PUT /identity/v3/projects/279b177b69384d73970e965046469e67/users/52b82ef827204a09adc06d232e7489a1/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:39.034187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:39.034434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:39.040372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:39.064197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] MFA Rules not processed for user `52b82ef827204a09adc06d232e7489a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:39.065522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:39.138319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1048/2135] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:39.151335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:39.153480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:39.222468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf68e-9db1-4bf7-82aa-8460800ead19 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:39.227590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:39.228316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:39.228764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:39.232399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:39.238238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:39.239895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1e07a-4e1e-44e2-bc65-a112bab316cd service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:39.250617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1088/2136] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:39.270982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:39.337500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590612eb-6972-4140-93ac-71cdb6c791b9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:39.342261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:39.343187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:39.344244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:39.344415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] PATH_INFO: `/v3/users/52b82ef827204a09adc06d232e7489a1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:39.345776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b82ef827204a09adc06d232e7489a1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:39.347813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:39.511898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b82ef827204a09adc06d232e7489a1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:39.512559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b82ef827204a09adc06d232e7489a1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:39.521455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:39.567769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b82ef827204a09adc06d232e7489a1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:39.568424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b82ef827204a09adc06d232e7489a1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:39.581134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b82ef827204a09adc06d232e7489a1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:39.593051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1049/2137] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:39 2022] DELETE /identity/v3/users/52b82ef827204a09adc06d232e7489a1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:39.598348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:39.598648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:39.598939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:39.617347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:39.618863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:39.681714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1089/2138] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:39.691634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:39.693079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:39.752888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216620be-a987-426e-8747-65e8637bf413 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:39.756583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:39.757222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:39.757504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:39.757780 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:39.766747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:39.768167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d69c84-c47e-42b8-a460-515fde6b37a0 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:39.777572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1050/2139] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:39.905667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:40.193001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.195675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:40.209196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702adab2-f9b1-4b1b-aede-acc501056aa3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.214229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.215139 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.219961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.219961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] PATH_INFO: `/v3/projects/279b177b69384d73970e965046469e67` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.219961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279b177b69384d73970e965046469e67)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.219961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.359974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279b177b69384d73970e965046469e67', 'request_id': 'req-2de4f585-bdb3-476d-9941-fc2a76d32534'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:40.442085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279b177b69384d73970e965046469e67', 'request_id': 'req-2de4f585-bdb3-476d-9941-fc2a76d32534'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:40.448942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279b177b69384d73970e965046469e67', 'request_id': 'req-2de4f585-bdb3-476d-9941-fc2a76d32534'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:40.455197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:40.462543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] The token cache is being invalidate because project 279b177b69384d73970e965046469e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:40.462840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:40.463549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2de4f585-bdb3-476d-9941-fc2a76d32534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:40.465958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1090/2140] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:40 2022] DELETE /identity/v3/projects/279b177b69384d73970e965046469e67 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:40.471617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.471902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.475901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.492948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:40.493153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:40.556937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1051/2141] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:40.564755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.565051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.565336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.583754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:40.585203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:40.593169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1091/2142] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:40.598153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.608074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f8aad-8eff-45c9-9795-d07bd8f3b000 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.612946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.613617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.613957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.614246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.615012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:40.615324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.616957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.628894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1052/2143] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:40.633445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.645720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b266-9375-4927-84a3-7a6e3a9041b1 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.647892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.648551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.648833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.649111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.649910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.651855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.740916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1092/2144] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:40 2022] POST /identity/v3/projects => generated 359 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:40.745127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.755806 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f3a05-90d7-4276-b553-82994c2d6d1a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.802697 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:40.812616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.813290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.813577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.813880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.814617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.818723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.870674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1053/2145] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:40 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:40.874368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.887847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25b4a-b277-437a-8c37-4f2e69d7fb46 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.901484 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.902550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.911419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.911744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.912612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.914363 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.926553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1093/2146] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:40.930734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.942221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add87f84-1da6-471c-8a09-e21518c6a224 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.951191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.953680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.953680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.953680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:40.953680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:40.955287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b4b43-f50e-433e-9117-adb62a9e05c6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:40.966568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1054/2147] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:40.971675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:40.983867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea07654-8da0-41bd-80ee-7abb9e0be177 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:40.989451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:40.990348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:40.990664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:40.990936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] PATH_INFO: `/v3/projects/837cb2c45aaa4b048ad9901ccffec786/users/25680db41af84ffda6f321c304c069b6/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:41.008850 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837cb2c45aaa4b048ad9901ccffec786, user_id=25680db41af84ffda6f321c304c069b6, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:41.012020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:41.019840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:41.082405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1094/2148] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:40 2022] PUT /identity/v3/projects/837cb2c45aaa4b048ad9901ccffec786/users/25680db41af84ffda6f321c304c069b6/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:41.087228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:41.087522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:41.087830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:41.126825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] MFA Rules not processed for user `25680db41af84ffda6f321c304c069b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:41.128324 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:41.217507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1055/2149] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:41.396758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:41.511451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:41.577534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:41.580260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:41.651069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0377e-f07c-4c2e-b180-33590458b170 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:41.657130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:41.657696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:41.657978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:41.658254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:41.666739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:41.668159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:41.678581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1095/2150] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:41.693834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:41.762891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67961e-efb3-48ac-9b2a-8d16cbfbf6fc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:41.772970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:41.772970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:41.772970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:41.772970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] PATH_INFO: `/v3/users/25680db41af84ffda6f321c304c069b6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:41.773300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25680db41af84ffda6f321c304c069b6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:41.774857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:41.799142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:41.800915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:41.816998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6132383-4e2b-407d-9f02-0960cecdaccc service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:41.821821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:41.822757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:41.823063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:41.823347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] PATH_INFO: `/v3/users/31dfefdd4b344e0ba22b0a4d5e8b0a40` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:41.824551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31dfefdd4b344e0ba22b0a4d5e8b0a40)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:41.826547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:42.001125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25680db41af84ffda6f321c304c069b6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.001725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25680db41af84ffda6f321c304c069b6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.050824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31dfefdd4b344e0ba22b0a4d5e8b0a40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.094988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25680db41af84ffda6f321c304c069b6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.095625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25680db41af84ffda6f321c304c069b6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.108012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f64c2c82-3b8f-4ad8-9582-782d50db7d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25680db41af84ffda6f321c304c069b6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.120538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1056/2151] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:41 2022] DELETE /identity/v3/users/25680db41af84ffda6f321c304c069b6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:42.124947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:42.125236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:42.125509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:42.143730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:42.144939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:42.190572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31dfefdd4b344e0ba22b0a4d5e8b0a40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.191254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31dfefdd4b344e0ba22b0a4d5e8b0a40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.198663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31dfefdd4b344e0ba22b0a4d5e8b0a40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.206973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1057/2152] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:42.214836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-9699954a-2ee2-4a2d-95df-70984dc04214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31dfefdd4b344e0ba22b0a4d5e8b0a40'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:42.222709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:42.224047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1096/2153] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:41 2022] DELETE /identity/v3/users/31dfefdd4b344e0ba22b0a4d5e8b0a40 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:42.225424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:42.228614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:42.229128 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:42.229235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:42.238106 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:42.248030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:42.249386 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:42.290284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80b9ae-8b1f-46b3-97e7-08e7cade23f3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:42.320317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1097/2154] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:42.346446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:42.347471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:42.348071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:42.348189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:42.348413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:42.348793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:42.350906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:42.363332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bef59c-b659-4bab-af99-022471a96711 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:42.363839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:42.365480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:42.367581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:42.368352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:42.368703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:42.369054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:42.377273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1058/2155] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:42.381181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:42.382741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:42.394727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1098/2156] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:42.512493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:42.965607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:42.967494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.027722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.027722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.034387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79c7c-60ca-4319-9191-0bd75d6b33fc service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.040884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.041773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.042056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.042334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] PATH_INFO: `/v3/projects/837cb2c45aaa4b048ad9901ccffec786` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.043669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] RBAC: Authorizing `identity:delete_project(project_id=837cb2c45aaa4b048ad9901ccffec786)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.045632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.085891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb0da5-20ec-4061-9e9f-dc7399d5dc38 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.090497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.091369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.091652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.091928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] PATH_INFO: `/v3/projects/fa2a4f3201ba474490b2876610d4fded` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.093157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2a4f3201ba474490b2876610d4fded)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.095737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.145720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837cb2c45aaa4b048ad9901ccffec786', 'request_id': 'req-5355acc7-3230-4ec9-9bce-cb479f38debb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.151581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837cb2c45aaa4b048ad9901ccffec786', 'request_id': 'req-5355acc7-3230-4ec9-9bce-cb479f38debb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.159627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837cb2c45aaa4b048ad9901ccffec786', 'request_id': 'req-5355acc7-3230-4ec9-9bce-cb479f38debb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.191710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2a4f3201ba474490b2876610d4fded', 'request_id': 'req-248332fc-6334-4037-a003-9e900fbb52d4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.261907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:43.268817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] The token cache is being invalidate because project 837cb2c45aaa4b048ad9901ccffec786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:43.269098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.269804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5355acc7-3230-4ec9-9bce-cb479f38debb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.271413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1059/2157] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:42 2022] DELETE /identity/v3/projects/837cb2c45aaa4b048ad9901ccffec786 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:43.276159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dd66-ac1d-4062-bac4-4db99aa4feff None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.276449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dd66-ac1d-4062-bac4-4db99aa4feff None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.276723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dd66-ac1d-4062-bac4-4db99aa4feff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.296294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2ec5dd66-ac1d-4062-bac4-4db99aa4feff None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:43.298240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2ec5dd66-ac1d-4062-bac4-4db99aa4feff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.350922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2a4f3201ba474490b2876610d4fded', 'request_id': 'req-248332fc-6334-4037-a003-9e900fbb52d4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.358301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2a4f3201ba474490b2876610d4fded', 'request_id': 'req-248332fc-6334-4037-a003-9e900fbb52d4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.365817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1060/2158] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:43.371636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] The token cache is being invalidate because project fa2a4f3201ba474490b2876610d4fded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:43.372303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.373275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.373513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.378802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.378802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.379009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1099/2159] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:43 2022] DELETE /identity/v3/projects/fa2a4f3201ba474490b2876610d4fded => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:43.381245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.383037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.396115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248332fc-6334-4037-a003-9e900fbb52d4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.401598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:43.401598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.402065 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.403259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.403604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.403948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] PATH_INFO: `/v3/users/43278d48926a4adb9c7a83c7c468137b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.405223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43278d48926a4adb9c7a83c7c468137b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.407420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1061/2160] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:43.407538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.411554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.420613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47af4a6-c142-4f60-bcb9-1cf333cc7b69 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.426622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.430516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.442302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1062/2161] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:43.446526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.454019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:43.456749 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122edf-0d1e-4140-b496-b94c760cbd09 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.461465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.462083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.462370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.462679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.463396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.465287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.575445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1063/2162] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:43 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:43.580118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.667428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43278d48926a4adb9c7a83c7c468137b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.693317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c2ad-589f-4ff0-a499-a7b602c8c216 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.704514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.705216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.705504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.705785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.706530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.708562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.769761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43278d48926a4adb9c7a83c7c468137b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.770666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43278d48926a4adb9c7a83c7c468137b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.778993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43278d48926a4adb9c7a83c7c468137b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.795425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43278d48926a4adb9c7a83c7c468137b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:43.803338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1100/2163] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:43 2022] DELETE /identity/v3/users/43278d48926a4adb9c7a83c7c468137b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:43.813982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1064/2164] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:43 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:43.817736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.819216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:43.943602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b53a-f928-4ead-9ee0-c2a26eba16c8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:43.955133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:43.956061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:43.956453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:43.956832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:43.957661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:43.959448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:43.979116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1101/2165] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:43.983017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:43.995101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e6af-74cb-4c23-884a-1ec1294b5570 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.001114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.001423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.001705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.001982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.002808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.004411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c0b6-2c37-4fbe-9b47-2aed2e56d9c3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:44.015830 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1065/2166] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:44.020775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:44.030720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86677f61-4adf-4b2b-a818-803d9138358b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.035482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.036362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.036645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.036927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] PATH_INFO: `/v3/projects/9d7c90da947e40aa831cfd2957995745/users/b48262b92d274751b1da492d403358df/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.053736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7c90da947e40aa831cfd2957995745, user_id=b48262b92d274751b1da492d403358df, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.056626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:44.141734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1102/2167] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:44 2022] PUT /identity/v3/projects/9d7c90da947e40aa831cfd2957995745/users/b48262b92d274751b1da492d403358df/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:44.153971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.154698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.154917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.185560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] MFA Rules not processed for user `b48262b92d274751b1da492d403358df`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:44.186834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:44.262332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1066/2168] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:44.276644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:44.277219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:44.283952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:44.363931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af6435-2e74-4634-9a21-8b13e680552b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.368279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.368929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.369216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.369553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.379438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.380885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d10264-9fe7-4eb7-b7f8-60a35376844b service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:44.389795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1103/2169] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:44.436672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:44.439587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:44.454255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:44.516849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618e3ae-957b-40c7-be99-cf3764fbbdd1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.523462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.524704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.524704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.524902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] PATH_INFO: `/v3/projects/6e50194862f947e79e6c20975fe470dd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.525998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e50194862f947e79e6c20975fe470dd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.532666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:44.626790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e50194862f947e79e6c20975fe470dd', 'request_id': 'req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:44.633058 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e50194862f947e79e6c20975fe470dd', 'request_id': 'req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:44.641728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e50194862f947e79e6c20975fe470dd', 'request_id': 'req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:44.744091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] The token cache is being invalidate because project 6e50194862f947e79e6c20975fe470dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:44.744380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:44.745072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bb0f1652-a3a0-468a-b72d-bad32c7b46f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:44.746708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1067/2170] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:44 2022] DELETE /identity/v3/projects/6e50194862f947e79e6c20975fe470dd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:44.752960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.753922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.754209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.776942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:44.779467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:44.836646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:44.846802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1104/2171] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:44.855877 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.856065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.856513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.864967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:44.878563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:44.879859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:44.892175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1068/2172] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:44.895558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:44.906390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a91482-0919-4d9c-ab53-917acccd4261 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.911769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.913267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.913557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.913840 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.914772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:44.915086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.926545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:44.946376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1105/2173] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:22:44.950766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:44.964456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8529-db34-4501-b619-b8965f0ef7c1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:44.969849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:44.972304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:44.972623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:44.973086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:44.973704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:44.975656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.079340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1069/2174] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:44 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:45.083478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.096306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3a62-9a68-4928-ac80-eee3dc47b4a8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.167799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.168526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.168815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.169100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.169843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.173392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.266623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1106/2175] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:45 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:45.278319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.289538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338d795-de2f-43ba-9cd0-cf77ceba3b73 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.295013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.295712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.295998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.297024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.298120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.299808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.313668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1070/2176] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:45.314927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.322729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:45.326342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9731-a119-4d64-9a04-ae205dcb58bd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.331519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.332181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.332470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.332749 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.333469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.335135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ef0c-a4b3-4c83-86ad-c54e3c24635b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.346803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1107/2177] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:45.350908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.362263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1383de8-c060-41ee-8943-be6b3ae98302 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.366959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.367878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.368187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.368466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] PATH_INFO: `/v3/projects/232e5921138546ff83e1e41b2c37cdd7/users/4f616cd880e543488114a04c1776774f/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.383887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] RBAC: Authorizing `identity:create_grant(project_id=232e5921138546ff83e1e41b2c37cdd7, user_id=4f616cd880e543488114a04c1776774f, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.386604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.499259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1071/2178] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:45 2022] PUT /identity/v3/projects/232e5921138546ff83e1e41b2c37cdd7/users/4f616cd880e543488114a04c1776774f/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:45.510081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.510399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.510710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.539110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] MFA Rules not processed for user `4f616cd880e543488114a04c1776774f`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:45.540364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:45.585604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:45.619899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1108/2179] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:45.624403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.701846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3688f6-066b-4891-92e4-662fba60253a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.715255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.715965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.716252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.716531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.717243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.719279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.785176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:45.804528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1072/2180] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:45 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:22:45.808154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:45.819727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c162f5-0d4f-4a34-92cf-3bffe2006d88 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:45.878226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:45.878977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:45.879269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:45.879551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:45.880380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:45.882023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:45.882342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:45.991598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1109/2181] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:45 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:45.995718 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:46.006703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aff6e3-3e5a-4fde-bf3c-f63db427a914 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:46.012300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:46.013032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.013321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.013607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.014377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:46.016064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:46.026966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1073/2182] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:46.031923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:46.047054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1b79-01b3-431d-b5e2-ec6a260269a4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:46.052760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:46.053653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.053936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.054216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] PATH_INFO: `/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a/users/79a79e6d4c2a409996fa96735fcafacd/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.074643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e1db1057dd445c9df02d3a649f4b8a, user_id=79a79e6d4c2a409996fa96735fcafacd, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:46.077346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:46.145892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1110/2183] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:46 2022] PUT /identity/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a/users/79a79e6d4c2a409996fa96735fcafacd/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:46.152563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:46.163755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15aa6-63ab-4604-9e93-ab11e78a03ad admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:46.226237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:46.226951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.227491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.227772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.228531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:46.230666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afcc8-d113-41ce-9d14-57c54e59210d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:46.248020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1074/2184] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:46.248908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:46.259574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5c23-9ab2-4f59-bbdd-f7fb75e34a54 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:46.264280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:46.265802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.266088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.266519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] PATH_INFO: `/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a/users/79a79e6d4c2a409996fa96735fcafacd/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.268549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e1db1057dd445c9df02d3a649f4b8a, user_id=79a79e6d4c2a409996fa96735fcafacd, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:46.271401 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:46.282862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1111/2185] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:46 2022] PUT /identity/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a/users/79a79e6d4c2a409996fa96735fcafacd/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:46.293822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.294119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.294394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.324910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] MFA Rules not processed for user `79a79e6d4c2a409996fa96735fcafacd`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:46.326161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:46.430979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1075/2186] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:46.444216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:46.447103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:46.488210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:46.520138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d148a9-58ba-4d8d-8a72-69470f7bcc00 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:46.523939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:46.524591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:46.524876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:46.525154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:46.535517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:46.536973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f290be5-1147-4c55-93b2-b07106a758bf service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:46.547075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1112/2187] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:46.699387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:47.553151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:47.636307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:47.637725 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d3d5f-3387-417f-9a6a-5f2fd38e1faf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:47.643341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:47.644236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:47.644524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:47.644801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] PATH_INFO: `/v3/users/4f616cd880e543488114a04c1776774f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:47.646028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f616cd880e543488114a04c1776774f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:47.648168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:47.781757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:47.924979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f616cd880e543488114a04c1776774f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:47.925671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f616cd880e543488114a04c1776774f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:47.996150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f616cd880e543488114a04c1776774f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:47.996764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f616cd880e543488114a04c1776774f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:48.010537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f616cd880e543488114a04c1776774f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:48.023841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1076/2188] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:47 2022] DELETE /identity/v3/users/4f616cd880e543488114a04c1776774f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:48.028598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:48.028888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:48.029175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:48.058024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:48.059282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:48.118994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1113/2189] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:48.128667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:48.130129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:48.223221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0af3-4154-4099-a5d1-cf3d85588810 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:48.226927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:48.227603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:48.227886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:48.228266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:48.238763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:48.240291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:48.251582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1077/2190] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:48.267532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:48.380457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:48.769375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:48.834233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:48.836506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:48.850683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ef887-992f-4c9f-8f6f-cdb1ccc4e490 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:48.856070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:48.857291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:48.857787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:48.858260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] PATH_INFO: `/v3/projects/232e5921138546ff83e1e41b2c37cdd7` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:48.860146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232e5921138546ff83e1e41b2c37cdd7)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:48.862091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:48.867661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:49.038667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232e5921138546ff83e1e41b2c37cdd7', 'request_id': 'req-fe9db58b-f99a-4134-a638-8e6903fe0ba4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.117635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232e5921138546ff83e1e41b2c37cdd7', 'request_id': 'req-fe9db58b-f99a-4134-a638-8e6903fe0ba4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.127691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232e5921138546ff83e1e41b2c37cdd7', 'request_id': 'req-fe9db58b-f99a-4134-a638-8e6903fe0ba4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.145456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] The token cache is being invalidate because project 232e5921138546ff83e1e41b2c37cdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:49.145757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.146458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.148437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1114/2191] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:48 2022] DELETE /identity/v3/projects/232e5921138546ff83e1e41b2c37cdd7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:49.152450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:49.163919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48059e-5227-4914-a6b8-4f2d816280ac service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:49.232003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:49.233071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:49.233357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:49.245074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] PATH_INFO: `/v3/users/79a79e6d4c2a409996fa96735fcafacd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:49.245074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a79e6d4c2a409996fa96735fcafacd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:49.245074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:49.373661 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:49.443509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a79e6d4c2a409996fa96735fcafacd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.444168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a79e6d4c2a409996fa96735fcafacd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.658820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a79e6d4c2a409996fa96735fcafacd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.659380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a79e6d4c2a409996fa96735fcafacd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.671929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c241bbba-32c7-4fba-adce-4ccfd22ecce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a79e6d4c2a409996fa96735fcafacd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:49.684164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1078/2192] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:49 2022] DELETE /identity/v3/users/79a79e6d4c2a409996fa96735fcafacd => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:50.099644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:50.277842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:50.279701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:50.293285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db58b-f99a-4134-a638-8e6903fe0ba4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:50.353472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:50.354444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:50.354740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:50.355022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] PATH_INFO: `/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:50.356216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e1db1057dd445c9df02d3a649f4b8a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:50.358161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:50.522181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e1db1057dd445c9df02d3a649f4b8a', 'request_id': 'req-fc7f6797-4840-4210-ae80-3b585d35d7ce'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:50.590181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e1db1057dd445c9df02d3a649f4b8a', 'request_id': 'req-fc7f6797-4840-4210-ae80-3b585d35d7ce'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:50.598307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e1db1057dd445c9df02d3a649f4b8a', 'request_id': 'req-fc7f6797-4840-4210-ae80-3b585d35d7ce'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:50.611019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] The token cache is being invalidate because project f2e1db1057dd445c9df02d3a649f4b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:50.614070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:50.614070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fc7f6797-4840-4210-ae80-3b585d35d7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:50.614070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1115/2193] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:50 2022] DELETE /identity/v3/projects/f2e1db1057dd445c9df02d3a649f4b8a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:50.618649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:50.619111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:50.619331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:50.656895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:50.658116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:50.722856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1079/2194] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:50.730827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:50.731347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:50.731732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:50.758148 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:50.759529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:50.769611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1116/2195] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:50.774250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:50.784761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c2514-e94e-4813-8385-e109147fb6ca None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:50.789385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:50.790095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:50.790362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:50.790670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:50.791394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:50.791701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:50.793302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:50.806040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1080/2196] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:50.810327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:50.825879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b647-86b7-437b-82d1-f19719800ba0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:50.832988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:50.833946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:50.834169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:50.834633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:50.835382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:50.837369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:50.934341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1117/2197] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:50 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:50.939244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:50.950252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb01576-98f1-4958-bcec-23055cca1284 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:51.011048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:51.019081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.019379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.019683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.020404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:51.027486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:51.115403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1081/2198] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:50 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:51.116974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:51.127509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2e3f-8e77-4085-b86d-80160e10bb7a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:51.132357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:51.133023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.133378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.133680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.134517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:51.136129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:51.148281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1118/2199] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:51.152438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:51.168924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e419-55ac-4659-9173-57904f974835 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:51.175554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:51.176606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.176992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.178788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.179697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:51.181456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92376d-7fc7-4111-a9f5-ba017c6aa9a8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:51.194792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1082/2200] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:51.198720 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:51.218479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a31aa-f8a6-4924-9e84-b1db762efd98 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:51.225519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:51.226509 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.226863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.227225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] PATH_INFO: `/v3/projects/0773a5b121b04e948b2fdcfaa45f7696/users/6d1a09581bf048caaabb72d237705ee4/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.243457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0773a5b121b04e948b2fdcfaa45f7696, user_id=6d1a09581bf048caaabb72d237705ee4, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:51.246290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:51.489142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1119/2201] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:51 2022] PUT /identity/v3/projects/0773a5b121b04e948b2fdcfaa45f7696/users/6d1a09581bf048caaabb72d237705ee4/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:51.500292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.500603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.500888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.527964 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] MFA Rules not processed for user `6d1a09581bf048caaabb72d237705ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:51.530471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:51.597520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1083/2202] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:51.612288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:51.614612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:51.681004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a66e-b01a-404b-ac78-d18af3a58e0d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:51.684672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:51.685326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:51.685611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:51.685888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:51.695549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:51.696987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb3174-291d-48c4-86ef-187095704653 service glance] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:51.706166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1120/2203] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:51.721879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:52.111197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:53.384318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:55.408146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:55.409576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:55.477557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef27230-163e-46e2-92a1-21d5f33ae4fd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:55.482435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:55.483557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:55.484008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:55.484484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] PATH_INFO: `/v3/users/27dd159210d84e0bb364f23d34c99566` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:55.486563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dd159210d84e0bb364f23d34c99566)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:55.490099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:55.706842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:55.708500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dd159210d84e0bb364f23d34c99566'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:55.709142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dd159210d84e0bb364f23d34c99566'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:55.767174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dd159210d84e0bb364f23d34c99566'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:55.767898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dd159210d84e0bb364f23d34c99566'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:55.780902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dd159210d84e0bb364f23d34c99566'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:55.793717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1084/2204] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:55 2022] DELETE /identity/v3/users/27dd159210d84e0bb364f23d34c99566 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:55.798601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:55.799104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:55.799220 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:55.818036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:55.819303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:55.880971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1121/2205] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:55.891262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:55.893507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:55.957033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d13e-e5ce-4646-b13b-b239ab944dc2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:55.960832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:55.961504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:55.961789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:55.962062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:55.971509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:55.972947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59519d1-c057-4b29-b703-516d3a3a2a65 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:55.982834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1085/2206] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:22:56.456169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:56.457633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:56.473141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c78d2-80ab-4aee-9ef3-1938cac2da93 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:56.479674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:56.481798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:56.482145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:56.482499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] PATH_INFO: `/v3/projects/b878b750ba174ad696122e0748d7ec96` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:56.483862 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b878b750ba174ad696122e0748d7ec96)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:56.486226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:56.610306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:56.619992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b878b750ba174ad696122e0748d7ec96', 'request_id': 'req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:56.681320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b878b750ba174ad696122e0748d7ec96', 'request_id': 'req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:56.687763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b878b750ba174ad696122e0748d7ec96', 'request_id': 'req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:56.699726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] The token cache is being invalidate because project b878b750ba174ad696122e0748d7ec96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:56.700531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:56.701400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3a0ab43e-efd9-4f9d-9da9-67c4a1763d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:56.703796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1122/2207] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:56 2022] DELETE /identity/v3/projects/b878b750ba174ad696122e0748d7ec96 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:56.716202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:56.719602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:56.720052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:56.751804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:56.753108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:56.826253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1086/2208] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:22:56.834370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:56.835011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:56.835011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:56.854626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:56.855853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:56.866347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1123/2209] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:56.874770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:56.884677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5a5f-f79a-458a-80c8-a9104601c2f0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:56.889455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:56.890240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:56.890592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:56.890880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:56.891873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:22:56.891985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:56.893538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:56.921080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1087/2210] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:22:56.923161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:56.933993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0c96-29a9-466f-a879-6e6a97fd7414 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:56.941186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:56.941853 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:56.942140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:56.942469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:56.943289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:56.945209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.060691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1124/2211] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:22:56 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:57.065656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.075755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0764d1-7ffd-4556-a768-3b28cc293c1f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.135464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:57.151297 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.152093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.152453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.152797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.153692 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.156870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.306937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.308754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:57.321843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490921-e9c2-4fd1-80cd-5f57d08177bf admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.326926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1088/2212] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:22:57 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:22:57.327549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.327988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.328353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.328636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] PATH_INFO: `/v3/users/c346c25250bb41f9b5fe30173914f452` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.329263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.329817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c346c25250bb41f9b5fe30173914f452)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.331847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.339370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1532b85-e372-4c0d-ae90-cf026e8ff1d8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.344757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.345513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.345817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.346246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.346906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.348878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.362346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1089/2213] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:22:57.376873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.391705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6be7-9aa7-4d26-b571-bf6b1dbd1ee9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.396902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.399639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.399639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.399639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.399639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.400835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.413041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1090/2214] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:22:57.419403 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.432646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf939aa-06c4-4fae-9503-90b50401e2b5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.437727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.438647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.439246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.439246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] PATH_INFO: `/v3/projects/3e7c7d02615c45e792f54437c7ffe502/users/3ec0238d4cec4ac5afaacf7d9efe2dc2/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.455933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7c7d02615c45e792f54437c7ffe502, user_id=3ec0238d4cec4ac5afaacf7d9efe2dc2, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.458625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c02e3-a400-43ed-9623-5e35c1b3ac06 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.554935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c346c25250bb41f9b5fe30173914f452'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:57.581752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1091/2215] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:22:57 2022] PUT /identity/v3/projects/3e7c7d02615c45e792f54437c7ffe502/users/3ec0238d4cec4ac5afaacf7d9efe2dc2/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:57.591302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.591591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.591867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.619169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] MFA Rules not processed for user `3ec0238d4cec4ac5afaacf7d9efe2dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:57.620372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:57.635754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c346c25250bb41f9b5fe30173914f452'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:57.640075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c346c25250bb41f9b5fe30173914f452'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:57.646528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c346c25250bb41f9b5fe30173914f452'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:57.660660 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bcf51fc-681d-4ddf-ab3a-ab8a52920ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c346c25250bb41f9b5fe30173914f452'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:57.666837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1125/2216] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:57 2022] DELETE /identity/v3/users/c346c25250bb41f9b5fe30173914f452 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:57.671165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.671557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.671903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.693118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:22:57.694353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:57.698047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1092/2217] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:57.709662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.710983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:57.757154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1126/2218] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:22:57.767338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:57.768845 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:57.774154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b51a-c01a-46e6-b03e-36852607d1f4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.782561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:57.846768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc65a1-b28b-4dff-aced-6b3a96613931 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:57.850632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:57.854256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.854943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.855227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.855503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.866482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:57.867149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:57.867444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:57.867728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:57.875176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.876651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.892394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1127/2219] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:57.956530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:57.959059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:57.975451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1093/2220] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:22:58.542711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:58.547612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:58.603059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3bb0-ca0f-43e6-85e4-ca5a972b30d2 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:58.616415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:58.616415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:58.616415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:58.616415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] PATH_INFO: `/v3/projects/6d28898e8ea9499bbbc70558ad4b945d` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:58.617284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d28898e8ea9499bbbc70558ad4b945d)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:58.619371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:58.769527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d28898e8ea9499bbbc70558ad4b945d', 'request_id': 'req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:58.836104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d28898e8ea9499bbbc70558ad4b945d', 'request_id': 'req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:58.842326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d28898e8ea9499bbbc70558ad4b945d', 'request_id': 'req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:58.856435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] The token cache is being invalidate because project 6d28898e8ea9499bbbc70558ad4b945d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:22:58.856435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:58.856435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:58.857623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1128/2221] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:58 2022] DELETE /identity/v3/projects/6d28898e8ea9499bbbc70558ad4b945d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:22:58.861788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:58.873480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89efb-1ee8-4e91-b0ce-20098e27beb3 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:58.934969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:58.935841 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:58.936651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:58.936928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] PATH_INFO: `/v3/users/77afae55bfa54a35ab4f3d5863f9a57a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:58.938212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77afae55bfa54a35ab4f3d5863f9a57a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:58.940188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:59.141356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77afae55bfa54a35ab4f3d5863f9a57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:59.142017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77afae55bfa54a35ab4f3d5863f9a57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:59.219920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77afae55bfa54a35ab4f3d5863f9a57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:59.221378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77afae55bfa54a35ab4f3d5863f9a57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:59.236452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a2dff748-f244-44d4-999b-e1cf0465961b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77afae55bfa54a35ab4f3d5863f9a57a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:22:59.251623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1094/2222] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:22:58 2022] DELETE /identity/v3/users/77afae55bfa54a35ab4f3d5863f9a57a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:22:59.726196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:22:59.728730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:22:59.748010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb2a7-6f53-4ff7-869f-057fc25e1944 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:22:59.822782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:22:59.823803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:22:59.824190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:22:59.824568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] PATH_INFO: `/v3/projects/d54fe7377ac345f795a6930a011ee7f3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:22:59.825940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54fe7377ac345f795a6930a011ee7f3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:22:59.828944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:22:59.984648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:59.994383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54fe7377ac345f795a6930a011ee7f3', 'request_id': 'req-c8468647-80a8-4bf6-b472-de87f1fccb41'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:00.036456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54fe7377ac345f795a6930a011ee7f3', 'request_id': 'req-c8468647-80a8-4bf6-b472-de87f1fccb41'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:00.044553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54fe7377ac345f795a6930a011ee7f3', 'request_id': 'req-c8468647-80a8-4bf6-b472-de87f1fccb41'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:00.056232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] The token cache is being invalidate because project d54fe7377ac345f795a6930a011ee7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:00.056523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:00.057448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c8468647-80a8-4bf6-b472-de87f1fccb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:00.058881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1129/2223] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:22:59 2022] DELETE /identity/v3/projects/d54fe7377ac345f795a6930a011ee7f3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:00.064129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae418-5703-4159-beda-26b53d85113f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.066581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae418-5703-4159-beda-26b53d85113f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.066581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae418-5703-4159-beda-26b53d85113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.084404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f51ae418-5703-4159-beda-26b53d85113f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:00.089333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f51ae418-5703-4159-beda-26b53d85113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:00.095967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:00.151293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1095/2224] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:00.159641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.159925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.160227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.178576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:00.181533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:00.188346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1130/2225] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:00.192793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ae418-5703-4159-beda-26b53d85113f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.203703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ae418-5703-4159-beda-26b53d85113f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.208395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.210256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.210256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.210256 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.210598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:00.210691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.212263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.224239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1096/2226] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:00.228461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.237668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43d91c-9879-4a85-a9b3-3bcdfd3273a8 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.242283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.242976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.243256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.243529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.244221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.246154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.330631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1131/2227] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:23:00.331678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.344531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf908b-3643-4fcf-afd8-7eadd8fde63b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.411757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.412429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.412709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.412981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.413670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.415706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.533844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1097/2228] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:00.537685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.548498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75784-1c95-442d-aa2b-36d5df6ac4ce admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.553479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.554133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.554437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.554724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.555448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.557071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.568253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1132/2229] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:00.572542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.583277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a262b3-2a01-4fd5-9696-9dcdd1ce8d8a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.588015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.588674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.588962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.589243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.589965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.591607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044fe2e-7589-46da-bc34-8b9c4efb57a5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.602207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1098/2230] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:00.606657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.616654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540f94-3ef3-4570-b3a3-347f1bbb151c admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.621173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.622044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.622329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.622674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] PATH_INFO: `/v3/projects/98030edc966a4e2a8dbd380f95331546/users/8ecee7cebffe42b59e7051d3d76fc1c0/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.637237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98030edc966a4e2a8dbd380f95331546, user_id=8ecee7cebffe42b59e7051d3d76fc1c0, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.640558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:00.718446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1133/2231] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:00 2022] PUT /identity/v3/projects/98030edc966a4e2a8dbd380f95331546/users/8ecee7cebffe42b59e7051d3d76fc1c0/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:00.729462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.729999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.730382 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.758577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] MFA Rules not processed for user `8ecee7cebffe42b59e7051d3d76fc1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:00.759816 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:00.835625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1099/2232] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:00.840614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:00.917493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b00061-284a-4e38-9373-cf1edf34c18e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:00.922952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:00.923626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:00.923909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:00.924186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:00.924891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:00.927099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.025373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1134/2233] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:00 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:01.035163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.047334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9154e58-b688-46a8-a745-15f53be891a4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.056101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:01.111209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.112016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.112624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.112907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.113596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.115696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.247943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1100/2234] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:01 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:01.251779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.261955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79ff3-ecf1-483f-a1db-54cdf3f21a80 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.267785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.268492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.268782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.269063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.269807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.271472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.289789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1135/2235] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:01.294104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.305394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8c6d-430e-473e-8a87-472f6798e90a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.310147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.314495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.314495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.314495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] PATH_INFO: `/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9/users/affb970426d640f2872a3f898004f013/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.327901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32110b18bb94deea9fdfe0ee4812aa9, user_id=affb970426d640f2872a3f898004f013, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.330792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810234-67b6-46dd-8dfa-7e05c96affa1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.429934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1101/2236] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:01 2022] PUT /identity/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9/users/affb970426d640f2872a3f898004f013/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:01.434289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.445020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6ace4-b3d2-452c-8c2b-908517033a9d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.495327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:01.500927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.501151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.501428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.522127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] MFA Rules not processed for user `f51fcc2493544ba381fe05c979302c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:01.523497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:01.525963 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.526666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.526956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.527243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.527970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.530437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.541256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1136/2237] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:01.545310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.555998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a75e-14c0-4a37-9e98-2ff9d4f615da admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.568924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.570158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.570595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.577075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] PATH_INFO: `/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9/users/affb970426d640f2872a3f898004f013/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.577075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32110b18bb94deea9fdfe0ee4812aa9, user_id=affb970426d640f2872a3f898004f013, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.577481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab091e-e33a-4a7d-a372-edd2eef53ff5 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.590640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1137/2238] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:01 2022] PUT /identity/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9/users/affb970426d640f2872a3f898004f013/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:01.607940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.608353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.608833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.629518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1102/2239] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:01.646740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] MFA Rules not processed for user `affb970426d640f2872a3f898004f013`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:01.647925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:01.728058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1138/2240] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:01.740800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:01.742515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:01.834133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3929-07ac-4219-8311-5639d3f167b8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:01.883031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:01.908656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269772-af6c-4143-a53b-4325588adace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:01.909329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269772-af6c-4143-a53b-4325588adace service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:01.909614 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269772-af6c-4143-a53b-4325588adace service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:01.909893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269772-af6c-4143-a53b-4325588adace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:01.919770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269772-af6c-4143-a53b-4325588adace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:01.922475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269772-af6c-4143-a53b-4325588adace service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:01.935270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1103/2241] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:06.393777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:06.458769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124687-74c0-4bb8-8849-bd4ab1b2c9dc None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:06.464280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:06.465167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:06.465564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:06.465854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] PATH_INFO: `/v3/users/8ecee7cebffe42b59e7051d3d76fc1c0` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:06.467416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecee7cebffe42b59e7051d3d76fc1c0)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:06.487640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:06.710584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:06.713892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecee7cebffe42b59e7051d3d76fc1c0'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:06.818892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecee7cebffe42b59e7051d3d76fc1c0'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:06.819769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecee7cebffe42b59e7051d3d76fc1c0'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:06.829735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecee7cebffe42b59e7051d3d76fc1c0'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:06.846313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecee7cebffe42b59e7051d3d76fc1c0'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:06.853769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1139/2242] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:06 2022] DELETE /identity/v3/users/8ecee7cebffe42b59e7051d3d76fc1c0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:06.860236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:06.860788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:06.861018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:06.890357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:06.891683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:06.974598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1104/2243] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:06.988208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:06.990901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:07.075752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa419947-7ef7-4c0c-85e9-898d8f25fa46 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:07.086602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:07.086602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:07.086602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:07.086602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:07.102694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:07.104160 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:07.135982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1140/2244] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:07.700496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:07.703779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:07.721242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee1c2-b31e-4023-860f-355cbdf44eca None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:07.734894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:07.736432 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:07.736868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:07.737307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] PATH_INFO: `/v3/projects/98030edc966a4e2a8dbd380f95331546` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:07.738870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=98030edc966a4e2a8dbd380f95331546)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:07.741585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:07.877449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98030edc966a4e2a8dbd380f95331546', 'request_id': 'req-097fadf4-9686-41b2-adf1-994b75fba6ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:07.884413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98030edc966a4e2a8dbd380f95331546', 'request_id': 'req-097fadf4-9686-41b2-adf1-994b75fba6ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:07.898220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98030edc966a4e2a8dbd380f95331546', 'request_id': 'req-097fadf4-9686-41b2-adf1-994b75fba6ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:07.978045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] The token cache is being invalidate because project 98030edc966a4e2a8dbd380f95331546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:07.978331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:07.979147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:07.980875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1105/2245] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:07 2022] DELETE /identity/v3/projects/98030edc966a4e2a8dbd380f95331546 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:07.985915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:07.995988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbe24-0af1-4772-b077-67a18907b25a service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:08.075997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:08.077999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:08.078283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:08.078743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] PATH_INFO: `/v3/users/affb970426d640f2872a3f898004f013` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:08.079999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affb970426d640f2872a3f898004f013)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:08.081950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:08.313674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affb970426d640f2872a3f898004f013'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:08.392666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affb970426d640f2872a3f898004f013'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:08.393601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affb970426d640f2872a3f898004f013'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:08.402280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affb970426d640f2872a3f898004f013'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:08.405329 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.416313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1e13c66c-25a1-4af4-b627-43f48d473d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affb970426d640f2872a3f898004f013'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:08.427972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1141/2246] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:07 2022] DELETE /identity/v3/users/affb970426d640f2872a3f898004f013 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:08.907180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:08.910342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:08.927795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fadf4-9686-41b2-adf1-994b75fba6ee admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.023682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.024552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.024834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.025132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] PATH_INFO: `/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.026323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32110b18bb94deea9fdfe0ee4812aa9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.028401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.036633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:09.149943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32110b18bb94deea9fdfe0ee4812aa9', 'request_id': 'req-42095fdf-7297-4746-8354-c2b9187f0a54'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:09.156509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32110b18bb94deea9fdfe0ee4812aa9', 'request_id': 'req-42095fdf-7297-4746-8354-c2b9187f0a54'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:09.163277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32110b18bb94deea9fdfe0ee4812aa9', 'request_id': 'req-42095fdf-7297-4746-8354-c2b9187f0a54'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:09.275287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] The token cache is being invalidate because project f32110b18bb94deea9fdfe0ee4812aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:09.275717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:09.276358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-42095fdf-7297-4746-8354-c2b9187f0a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:09.278008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1106/2247] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:08 2022] DELETE /identity/v3/projects/f32110b18bb94deea9fdfe0ee4812aa9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:09.284359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.284819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.285039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.326844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:09.328278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:09.399427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1142/2248] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:09.412632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.412632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.412632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.435776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:09.437175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:09.456744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1107/2249] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:09.461066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.471761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8fa5-0a2e-4fc6-812e-3841d3515e67 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.476582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.477304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.477597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.477883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.478654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:09.478969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.480656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.493056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1143/2250] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:09.497598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.507429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc48bb-dd5e-4086-87a6-07b06ab28563 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.512288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.512941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.513224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.513500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.514850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.516818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.636934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1108/2251] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:09 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:09.641796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.651834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a2a1-f5c8-4886-bd28-0d93104712da admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.709058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.709852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.710251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.710628 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.711332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.713248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.828165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1144/2252] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:09 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:09.829487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.839958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789a6a-6977-4a1f-803e-869a0c40ffcf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.845950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.846655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.846940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.847216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.847974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.849580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.863285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1109/2253] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:09.867379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.878135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a9b9-3f88-4f08-b501-2df29debf3e8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.883130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.883789 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.884087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.884399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.885120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.886815 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1ea4-e9cb-42bd-bc58-96661e2a5300 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:09.899103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1145/2254] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:09.903145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:09.914491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b93f80-2b3a-476b-bca3-bacd1f9b7343 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:09.919401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:09.920459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:09.923332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:09.923332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] PATH_INFO: `/v3/projects/f5870510e0464f99a0785c63f40a831f/users/9a0418f27115486ab68cc5c0a312c314/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:09.948248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5870510e0464f99a0785c63f40a831f, user_id=9a0418f27115486ab68cc5c0a312c314, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:09.950965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.034873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1110/2255] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:09 2022] PUT /identity/v3/projects/f5870510e0464f99a0785c63f40a831f/users/9a0418f27115486ab68cc5c0a312c314/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:10.045223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.045711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.046002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.076229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] MFA Rules not processed for user `9a0418f27115486ab68cc5c0a312c314`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:10.078232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:10.109898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:10.147320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1146/2256] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:10.151970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.215176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ed03c-322c-4b38-a4e3-3347f34f448f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.220670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.221337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.221624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.221904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.222638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.224803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.346582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1111/2257] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:10 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:10.350323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.363179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d321-0780-46de-913e-58a6af25bb17 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.422920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.423728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.424018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.424298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.425037 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.427391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.589241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1147/2258] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:10 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:10.593537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.603771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fdd7-c55d-4cc2-a32c-d1eceff4bccb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.609161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.609919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.610291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.610786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.611627 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.613449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.625690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1112/2259] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:10.629837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.640679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b745a-0541-46ac-9671-37d34417b109 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.654008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.654008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.654008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.654008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] PATH_INFO: `/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a/users/bc2f5339b5a9489bbc9a029679332107/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.668110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d3fb1e363145bb9a4916c7ede0b10a, user_id=bc2f5339b5a9489bbc9a029679332107, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.671768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.767930 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1148/2260] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:10 2022] PUT /identity/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a/users/bc2f5339b5a9489bbc9a029679332107/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:10.772004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.778370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:10.783087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54241-b334-4f54-a25d-6ee1685f4c4e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.844048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.844729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.845119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.845590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.846582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.848624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e88d-ea37-4e83-9316-801ea50e658e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.859349 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1113/2261] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:10.863485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:10.874790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19f082-046c-4a2a-8ca0-aa173541fa6b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:10.889533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:10.889533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.889533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.889533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] PATH_INFO: `/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a/users/bc2f5339b5a9489bbc9a029679332107/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.890547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d3fb1e363145bb9a4916c7ede0b10a, user_id=bc2f5339b5a9489bbc9a029679332107, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:10.890547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:10.899383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1149/2262] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:10 2022] PUT /identity/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a/users/bc2f5339b5a9489bbc9a029679332107/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:10.909650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:10.909960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:10.910232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:10.939488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] MFA Rules not processed for user `bc2f5339b5a9489bbc9a029679332107`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:10.940777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:11.011819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1114/2263] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:11.023569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:11.025512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:11.088538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b8d6-420f-4cb3-ae81-067ac7361895 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:11.093169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:11.093813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:11.094097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:11.094373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:11.103530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:11.104952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:11.114934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1150/2264] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:11.224068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:11.233834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094945-15a0-45a2-9f8e-5127b3e4b34a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:11.239654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:11.239654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:11.239654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:11.239654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:11.303968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:11.305439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c23c0-c14f-4b83-8500-95f24d6b8120 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:11.316038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1115/2265] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:13.071585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:13.073101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:13.101543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:13.140544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256169-ee8d-4ccc-9016-ebc9c5c7278f service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:13.146539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:13.152981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:13.152981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:13.152981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] PATH_INFO: `/v3/users/3ec0238d4cec4ac5afaacf7d9efe2dc2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:13.152981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec0238d4cec4ac5afaacf7d9efe2dc2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:13.152981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:13.404608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec0238d4cec4ac5afaacf7d9efe2dc2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:13.492140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec0238d4cec4ac5afaacf7d9efe2dc2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:13.492777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec0238d4cec4ac5afaacf7d9efe2dc2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:13.503109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec0238d4cec4ac5afaacf7d9efe2dc2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:13.520469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec0238d4cec4ac5afaacf7d9efe2dc2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:13.526627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1151/2266] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:13 2022] DELETE /identity/v3/users/3ec0238d4cec4ac5afaacf7d9efe2dc2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:13.531383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:13.531863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:13.532007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:13.551986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:13.553332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:13.576647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:13.621003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1116/2267] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:13.632879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:13.635238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:13.697857 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f04c5-f401-4261-8c8b-4f26a0215016 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:13.702047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:13.702875 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:13.703166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:13.703448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:13.715899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:13.718088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:13.730598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1152/2268] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:14.192567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:14.193996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:14.207305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4e8c-e82d-4034-8bfa-c82c0f45a042 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:14.212144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:14.213016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.213298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.213573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] PATH_INFO: `/v3/projects/3e7c7d02615c45e792f54437c7ffe502` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.214814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7c7d02615c45e792f54437c7ffe502)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:14.217690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:14.405853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7c7d02615c45e792f54437c7ffe502', 'request_id': 'req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.411301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7c7d02615c45e792f54437c7ffe502', 'request_id': 'req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.417731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7c7d02615c45e792f54437c7ffe502', 'request_id': 'req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.494559 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:14.496453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:14.509863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889611b-cd21-47b6-b371-008dd2bbcb8f service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:14.532741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] The token cache is being invalidate because project 3e7c7d02615c45e792f54437c7ffe502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:14.533286 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.533708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0dcf4fd4-84c4-4e6b-accf-73a12ec8ebdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.536848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1117/2269] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:14 2022] DELETE /identity/v3/projects/3e7c7d02615c45e792f54437c7ffe502 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:14.542222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb5c4-047c-42fa-8586-f73606227912 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.542818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb5c4-047c-42fa-8586-f73606227912 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.543505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb5c4-047c-42fa-8586-f73606227912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.558658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:14.564918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6dfdb5c4-047c-42fa-8586-f73606227912 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:14.566130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6dfdb5c4-047c-42fa-8586-f73606227912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:14.573147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:14.574034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.574319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.574629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] PATH_INFO: `/v3/users/9a0418f27115486ab68cc5c0a312c314` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.576736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0418f27115486ab68cc5c0a312c314)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:14.578799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:14.632516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1118/2270] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:14.640372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.640670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.641073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.663919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:14.664769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:14.673564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1119/2271] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:14.677697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:14.687104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184a79a-ff5b-48cb-8982-7f1cbb2e3f21 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:14.691768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:14.692416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.692760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.693039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.693757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:14.694065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:14.695680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:14.715068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1120/2272] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:23:14.724129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:14.729796 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0cb7-1734-455d-9a8b-b9d29f18ebed admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:14.730110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0418f27115486ab68cc5c0a312c314'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.734828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:14.735524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.735809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.736084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.736811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:14.738832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:14.800975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0418f27115486ab68cc5c0a312c314'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.801851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0418f27115486ab68cc5c0a312c314'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.820469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0418f27115486ab68cc5c0a312c314'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.845668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1121/2273] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:14 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:23:14.849265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:14.850764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-8c8202f8-a2fc-4f2f-8bd6-c3c65dc7e997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0418f27115486ab68cc5c0a312c314'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:14.860009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1153/2274] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:14 2022] DELETE /identity/v3/users/9a0418f27115486ab68cc5c0a312c314 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:14.865182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:14.865646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:14.865946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:14.866231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:14.892578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:14.896273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:14.980327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd902-b357-499a-a86d-0e7b3973e3de admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:14.995273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1154/2275] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:15.011500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.016367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:15.055050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.055736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.056019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.056296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.057064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.059027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.094938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2d6c2-c281-48d6-9229-e4376bfea162 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.094938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.094938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.094938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.095225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.101442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.102985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.114105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1155/2276] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:15.221434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1122/2277] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:14 2022] POST /identity/v3/users => generated 287 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:15.222719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.224256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:15.237493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538901-e10e-4ad5-b4fe-a086aea28528 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.242698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.243400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.243717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.244000 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.244736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.246538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.258346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1156/2278] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:15.262329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.274044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36d39-6c1a-4f09-8a9f-e632de7170a9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.278742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.280526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.280813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.281095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.281826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.283460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7113b-d358-4dbc-acc6-c4950d88cc49 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.293456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1123/2279] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:15.298255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.308332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b692e-963e-4aa7-aeaa-0ece206598da admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.313539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.314442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.314755 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.315038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] PATH_INFO: `/v3/projects/fde57658f780423881ed97ad8c6a4a76/users/57076420f7ed4d3e88ab61ccd3208d0b/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.331138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde57658f780423881ed97ad8c6a4a76, user_id=57076420f7ed4d3e88ab61ccd3208d0b, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.333785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.449049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1157/2280] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:15 2022] PUT /identity/v3/projects/fde57658f780423881ed97ad8c6a4a76/users/57076420f7ed4d3e88ab61ccd3208d0b/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:15.454552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.455073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.455361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.479704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:15.480947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:15.552050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1124/2281] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:15.561766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.563516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:15.580920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.582327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:15.598138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c841fd-c5a8-4074-83ce-77f926b99b97 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.603822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.604927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.605446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.605707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] PATH_INFO: `/v3/projects/f5870510e0464f99a0785c63f40a831f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.606986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5870510e0464f99a0785c63f40a831f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.610889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.633525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edfc7-7b33-4698-bd1d-6692ba943dee admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.637426 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.638085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.639238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.639528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.648965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.650405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:15.660965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1158/2282] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:15.694310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5870510e0464f99a0785c63f40a831f', 'request_id': 'req-b36089d7-60c2-4ac0-8003-60543ed8b0a8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:15.700003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5870510e0464f99a0785c63f40a831f', 'request_id': 'req-b36089d7-60c2-4ac0-8003-60543ed8b0a8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:15.706340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5870510e0464f99a0785c63f40a831f', 'request_id': 'req-b36089d7-60c2-4ac0-8003-60543ed8b0a8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:15.763391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] The token cache is being invalidate because project f5870510e0464f99a0785c63f40a831f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:15.763704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:15.764454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:15.764584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:15.771185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:15.771752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1125/2283] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:15 2022] DELETE /identity/v3/projects/f5870510e0464f99a0785c63f40a831f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:15.786039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244075b2-5c74-4ae5-a148-b60142ac91fa service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:15.855812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:15.856892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:15.857848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:15.858538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] PATH_INFO: `/v3/users/bc2f5339b5a9489bbc9a029679332107` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:15.860023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2f5339b5a9489bbc9a029679332107)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:15.862130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:16.193497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2f5339b5a9489bbc9a029679332107'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:16.269266 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2f5339b5a9489bbc9a029679332107'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:16.269896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2f5339b5a9489bbc9a029679332107'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:16.277394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2f5339b5a9489bbc9a029679332107'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:16.289912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a343f82-9055-4c36-aed8-42d73da1205c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2f5339b5a9489bbc9a029679332107'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:16.296210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1159/2284] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:15 2022] DELETE /identity/v3/users/bc2f5339b5a9489bbc9a029679332107 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:16.391844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:16.833329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:16.835355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:16.855967 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36089d7-60c2-4ac0-8003-60543ed8b0a8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:16.942608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:16.942608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:16.942608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:16.942608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] PATH_INFO: `/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:16.942943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d3fb1e363145bb9a4916c7ede0b10a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:16.943443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.110786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d3fb1e363145bb9a4916c7ede0b10a', 'request_id': 'req-123730a2-d1aa-4e1b-b0cc-ec62852f105d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:17.116269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d3fb1e363145bb9a4916c7ede0b10a', 'request_id': 'req-123730a2-d1aa-4e1b-b0cc-ec62852f105d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:17.123155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d3fb1e363145bb9a4916c7ede0b10a', 'request_id': 'req-123730a2-d1aa-4e1b-b0cc-ec62852f105d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:17.213919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] The token cache is being invalidate because project 08d3fb1e363145bb9a4916c7ede0b10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:17.214325 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:17.215078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-123730a2-d1aa-4e1b-b0cc-ec62852f105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:17.218462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1126/2285] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:16 2022] DELETE /identity/v3/projects/08d3fb1e363145bb9a4916c7ede0b10a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:17.224322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.224818 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.224901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.250779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:17.256078 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:17.375716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1160/2286] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:17.383499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.383885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.384173 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.419488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:17.421848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:17.423182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:17.447717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1127/2287] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:17.450635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.461478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beca481-7349-4aff-ad15-406a8940f317 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.467864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.468542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.468824 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.469098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.469839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:17.470144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.472311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.488911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1161/2288] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:17.493456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.506856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016cb7-55d2-4477-b35f-2e9766dfe87f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.523598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.524339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.524691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.524914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.525670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.527739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.640017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1128/2289] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:17 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:17.641641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.656270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8103d-f8c0-4b58-ac26-672aec08da7e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.727469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.728158 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.728447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.728726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.729455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.731521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.816458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1162/2290] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:17 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:17.820681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.833181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f662a4-c990-4244-bde1-2d0db9e27db4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.839810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.841477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.841913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.844023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.845103 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.847741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.868461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1129/2291] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:17.872285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.885479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9bfd-bd18-439b-9f95-df1c6b88f0d2 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.897969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.898713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.899004 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.899287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.900045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.901694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd71f-73cd-45d8-b4f7-6b07b860f93a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.923734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1163/2292] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:17.931665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:17.943169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e7bb-b887-4663-89fe-1b3e13894f98 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:17.948515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:17.949815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:17.949815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:17.949996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] PATH_INFO: `/v3/projects/ac9d82ded3af478b9a3dcb27b72f7a4b/users/8e89ebf95470481396b77430fa250e77/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:17.979817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9d82ded3af478b9a3dcb27b72f7a4b, user_id=8e89ebf95470481396b77430fa250e77, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:17.986062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:17.989016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:18.087680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1130/2293] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:17 2022] PUT /identity/v3/projects/ac9d82ded3af478b9a3dcb27b72f7a4b/users/8e89ebf95470481396b77430fa250e77/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:18.096649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:18.096942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:18.097223 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:18.131871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] MFA Rules not processed for user `8e89ebf95470481396b77430fa250e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:18.134384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:18.214922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1164/2294] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:18.219756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:18.314253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56afea-542f-497e-b5ab-d77f5755e6ea admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:18.328623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:18.329672 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:18.330007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:18.330373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:18.331143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:18.333087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:18.500453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1131/2295] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:18 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:23:18.504580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:18.516837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4954-34c5-47e0-b138-740b49b5fb6c None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:18.574901 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:18.625489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:18.635452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:18.635452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:18.635452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:18.635452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:18.635452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:18.752550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1165/2296] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:18 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:18.763427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:18.781197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f882d-ab76-455f-86b9-796773800424 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:18.787449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:18.788228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:18.788565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:18.788846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:18.789770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:18.791255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:18.804960 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1132/2297] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:18.808766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:18.821247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54a88-775c-47df-9413-c10c1f99557b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:18.828483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:18.829523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:18.829814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:18.830091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] PATH_INFO: `/v3/projects/e65ef0beb5f14acc88818436fa60a170/users/347c22702b294e5083e18b304fc1c89b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:18.864161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65ef0beb5f14acc88818436fa60a170, user_id=347c22702b294e5083e18b304fc1c89b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:18.867817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:18.970760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1166/2298] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:18 2022] PUT /identity/v3/projects/e65ef0beb5f14acc88818436fa60a170/users/347c22702b294e5083e18b304fc1c89b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:18.973201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:18.985593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a14685-b9e8-43f7-b76b-21e12403f95c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:19.049742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:19.050893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:19.051184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:19.051467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:19.052430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:19.054120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0996c-0d6c-4416-949f-fe44ad8a9dc2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:19.064914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1133/2299] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:19.069115 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:19.081880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefa171-e037-4d7c-b19b-739272120a5a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:19.087097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:19.088928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:19.088928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:19.088928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] PATH_INFO: `/v3/projects/e65ef0beb5f14acc88818436fa60a170/users/347c22702b294e5083e18b304fc1c89b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:19.090978 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65ef0beb5f14acc88818436fa60a170, user_id=347c22702b294e5083e18b304fc1c89b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:19.094354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:19.113195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1167/2300] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:19 2022] PUT /identity/v3/projects/e65ef0beb5f14acc88818436fa60a170/users/347c22702b294e5083e18b304fc1c89b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:19.125329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:19.125857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:19.126212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:19.156794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] MFA Rules not processed for user `347c22702b294e5083e18b304fc1c89b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:19.158023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:19.235532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1134/2301] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:19.248736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:19.250904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:19.281615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:19.320686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069bb0-82aa-4ef7-bdaf-1394130d34fc admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:19.324525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:19.325388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:19.326184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:19.326925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:19.345513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:19.347039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f1bc8-13ae-4eec-b03e-c0cc2c3d05ae service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:19.358145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1168/2302] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:19.545599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:19.558814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c027f-4701-44f3-bb01-1c4096a931aa None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:19.564044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:19.564871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:19.565211 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:19.565665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:19.640090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:19.641693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d8c13-ddb0-48cc-a69d-28b30ca5c1e7 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:19.658526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1135/2303] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:22.083023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:22.083582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:22.083582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:22.110867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] MFA Rules not processed for user `9845bb45f86e4e6ca2da841bfc0d0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:22.112859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:22.195515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:22.228827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1169/2304] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:23.499401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:23.500265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:23.500781 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:23.535461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] MFA Rules not processed for user `57076420f7ed4d3e88ab61ccd3208d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:23.537449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:23.706641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1136/2305] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:23.706924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:23.708255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:23.817513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8d24-6782-41b5-a36b-5abec85e1845 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:23.831109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:23.832063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:23.832354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:23.832902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:23.833506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:23.835457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:23.978091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1170/2306] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:23 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:23.980609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:23.996176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc5b08-37b1-4825-9015-e4572b432c02 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:24.087149 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:24.092637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:24.092637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:24.092637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:24.092637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:24.092637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:24.105043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:24.213659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1137/2307] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:23 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:24.218094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:24.233658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa820-74a0-4b2f-b373-c20d2159268b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:24.238832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:24.239699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:24.239988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:24.240339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:24.241069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:24.242710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:24.257117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1171/2308] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:24.261470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:24.272119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49cec5-68fe-4495-aeb1-bc4f76008d7a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:24.276931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:24.279054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:24.279920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:24.279920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] PATH_INFO: `/v3/projects/212d3b9e0a9f493e818ee534472e0b0f/users/7c0a6a51b0dc4d439c7734fe47b026f6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:24.310019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=212d3b9e0a9f493e818ee534472e0b0f, user_id=7c0a6a51b0dc4d439c7734fe47b026f6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:24.312899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:24.389753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1138/2309] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:24 2022] PUT /identity/v3/projects/212d3b9e0a9f493e818ee534472e0b0f/users/7c0a6a51b0dc4d439c7734fe47b026f6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:24.397217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:24.405214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817c94-d31e-4bf6-b7d8-c0d88e790ffd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:24.475513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:24.476682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:24.477290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:24.477572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:24.478317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:24.480054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:24.493966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1172/2310] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:24.498905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:24.510507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f00cf-36e1-4780-b5eb-e4886984a48d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:24.517245 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:24.518354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:24.519002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:24.519592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] PATH_INFO: `/v3/projects/212d3b9e0a9f493e818ee534472e0b0f/users/7c0a6a51b0dc4d439c7734fe47b026f6/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:24.522063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=212d3b9e0a9f493e818ee534472e0b0f, user_id=7c0a6a51b0dc4d439c7734fe47b026f6, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:24.525316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e1f1-e8ed-40b4-acc9-e72303154e9c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:24.539434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1139/2311] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:24 2022] PUT /identity/v3/projects/212d3b9e0a9f493e818ee534472e0b0f/users/7c0a6a51b0dc4d439c7734fe47b026f6/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:25.274234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:25.276775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:25.335560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3460-a01a-4b40-8c96-776b6398b668 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:25.445420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:25.446498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:25.446848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:25.447285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] PATH_INFO: `/v3/users/6d1a09581bf048caaabb72d237705ee4` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:25.448680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1a09581bf048caaabb72d237705ee4)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:25.451799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:25.456195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:25.654487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1a09581bf048caaabb72d237705ee4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:25.754945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1a09581bf048caaabb72d237705ee4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:25.755707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1a09581bf048caaabb72d237705ee4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:25.765404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1a09581bf048caaabb72d237705ee4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:25.777772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1a09581bf048caaabb72d237705ee4'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:25.786265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1173/2312] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:25 2022] DELETE /identity/v3/users/6d1a09581bf048caaabb72d237705ee4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:25.796470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:25.797374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:25.797794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:25.818217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:25.819996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:25.887550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1140/2313] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:25.904607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:25.914748 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:26.039448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2a6b-2150-43da-a42f-e1865928f9fd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:26.043758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:26.045255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:26.045636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:26.046184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:26.059766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:26.061799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e8376-04f3-469b-8916-0a82a0c5bf3e service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:26.082968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1174/2314] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:26.868527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:26.871792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:26.895054 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ac0f-a5c5-4f88-9229-4a4e236c3b46 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:26.914378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:26.918569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:26.920086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:26.920480 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] PATH_INFO: `/v3/projects/0773a5b121b04e948b2fdcfaa45f7696` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:26.929239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0773a5b121b04e948b2fdcfaa45f7696)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:26.932016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:27.158001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0773a5b121b04e948b2fdcfaa45f7696', 'request_id': 'req-306ff398-5655-4da2-b85c-6834b3120b73'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:27.185467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0773a5b121b04e948b2fdcfaa45f7696', 'request_id': 'req-306ff398-5655-4da2-b85c-6834b3120b73'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:27.198164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0773a5b121b04e948b2fdcfaa45f7696', 'request_id': 'req-306ff398-5655-4da2-b85c-6834b3120b73'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:27.292792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] The token cache is being invalidate because project 0773a5b121b04e948b2fdcfaa45f7696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:27.293347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:27.295934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-306ff398-5655-4da2-b85c-6834b3120b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:27.302045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1141/2315] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:26 2022] DELETE /identity/v3/projects/0773a5b121b04e948b2fdcfaa45f7696 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:27.303621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.304096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.304334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.354541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:27.359760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:27.482873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.483656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.484097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.513412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1175/2316] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:27.513700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:27.515303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:27.526296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1142/2317] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:27.530546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:27.545827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd76b-fe86-417b-8bc0-9b50de1aafaa None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:27.554215 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:27.558639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.559483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.560270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.561694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:27.562066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:27.564185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:27.581802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1176/2318] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:27.585882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:27.597844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cda54-87b2-4429-9933-4b0b9916971d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:27.609543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:27.610794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.611340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.611802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.612767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:27.614983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:27.711377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1143/2319] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:27 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:27.713536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:27.730591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788028-8b63-4861-adbe-958e984b0af6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:27.749648 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:27.823467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:27.824122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.824413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.824694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.825597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:27.828274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:27.942908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1177/2320] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:27 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:27.948407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:27.959772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bed07-9871-4d71-a59c-b467b4406b38 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:27.964739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:27.965409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:27.966767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:27.967195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:27.979954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:27.979954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:27.984836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1144/2321] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:27.988522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:28.014376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b31c7-47bd-44ba-afd1-4ffda3a0ba2f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:28.042163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:28.048474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:28.048474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:28.048474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:28.048474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:28.049029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1d3b8-dfce-48be-95fc-b93176e94085 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:28.081061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1178/2322] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:28.085765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:28.092722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:28.101216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529c2b5-2dff-4e77-bc0f-3a83da7c87e4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:28.113558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:28.114507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:28.117053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:28.117679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] PATH_INFO: `/v3/projects/17d78571398b43b9a754e627bf908a1f/users/13a4a8034fb84afe82a2248248e23f93/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:28.142977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d78571398b43b9a754e627bf908a1f, user_id=13a4a8034fb84afe82a2248248e23f93, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:28.146772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:28.252216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1145/2323] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:28 2022] PUT /identity/v3/projects/17d78571398b43b9a754e627bf908a1f/users/13a4a8034fb84afe82a2248248e23f93/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:28.262858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:28.263302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:28.263590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:28.333474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] MFA Rules not processed for user `13a4a8034fb84afe82a2248248e23f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:28.349777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:28.533326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1179/2324] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:28.585978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:28.590850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:28.655035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:28.666574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:28.836653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80705e3-dc17-47a0-9b69-bcdf7639ffa1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:28.848282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:28.848282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:28.848282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:28.848282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:28.872305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b101c-5625-425e-be63-648ac8bc8d92 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:28.894071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:28.895646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf1968-997e-4ea4-a08d-c8997718e829 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:28.902491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:28.902491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:28.905397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:28.905691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] PATH_INFO: `/v3/users/8e89ebf95470481396b77430fa250e77` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:28.907364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e89ebf95470481396b77430fa250e77)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:28.912915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:28.937020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1146/2325] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:28.992144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:29.173017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e89ebf95470481396b77430fa250e77'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:29.293185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e89ebf95470481396b77430fa250e77'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:29.294487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e89ebf95470481396b77430fa250e77'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:29.303961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e89ebf95470481396b77430fa250e77'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:29.322313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e89ebf95470481396b77430fa250e77'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:29.341336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1180/2326] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:28 2022] DELETE /identity/v3/users/8e89ebf95470481396b77430fa250e77 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:29.345910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:29.346390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:29.346519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:29.372471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:29.374161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:29.479384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1147/2327] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:29.493237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:29.493237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:29.567107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4124-d106-4515-9d6d-6f4d9efed586 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:29.571653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:29.572332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:29.572623 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:29.572908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:29.588556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:29.591356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:29.615887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1181/2328] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:30.448332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:30.451647 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:30.477775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2de642-677e-49d3-a9f4-215ee00c125f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:30.486923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:30.486923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:30.486923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:30.486923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] PATH_INFO: `/v3/projects/ac9d82ded3af478b9a3dcb27b72f7a4b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:30.488150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9d82ded3af478b9a3dcb27b72f7a4b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:30.490251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:30.640541 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9d82ded3af478b9a3dcb27b72f7a4b', 'request_id': 'req-c1d9f742-1db4-4feb-9c03-619ef36b403c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:30.646086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:30.648171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9d82ded3af478b9a3dcb27b72f7a4b', 'request_id': 'req-c1d9f742-1db4-4feb-9c03-619ef36b403c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:30.687112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9d82ded3af478b9a3dcb27b72f7a4b', 'request_id': 'req-c1d9f742-1db4-4feb-9c03-619ef36b403c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.331779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] The token cache is being invalidate because project ac9d82ded3af478b9a3dcb27b72f7a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:31.341132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.341132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.341132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1148/2329] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:30 2022] DELETE /identity/v3/projects/ac9d82ded3af478b9a3dcb27b72f7a4b => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:31.341415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:31.349084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7b72c-3c75-4f58-9e81-e4f1851fe511 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:31.486672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:31.487553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:31.487851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:31.488131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] PATH_INFO: `/v3/users/347c22702b294e5083e18b304fc1c89b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:31.495280 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=347c22702b294e5083e18b304fc1c89b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:31.500825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:31.737099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:31.743941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347c22702b294e5083e18b304fc1c89b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.842530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347c22702b294e5083e18b304fc1c89b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.848018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347c22702b294e5083e18b304fc1c89b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.856919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347c22702b294e5083e18b304fc1c89b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.888728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-fd4ee2d0-e7eb-4ad8-91f7-8d52c6a2f0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347c22702b294e5083e18b304fc1c89b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:31.903307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1182/2330] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:31 2022] DELETE /identity/v3/users/347c22702b294e5083e18b304fc1c89b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:32.968293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:32.970010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:32.985794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f742-1db4-4feb-9c03-619ef36b403c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:33.097175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:33.098309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.098789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.106985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] PATH_INFO: `/v3/projects/e65ef0beb5f14acc88818436fa60a170` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.106985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65ef0beb5f14acc88818436fa60a170)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:33.106985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:33.244501 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65ef0beb5f14acc88818436fa60a170', 'request_id': 'req-2a9ec528-91e2-446b-893a-fe942304c54e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:33.251457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65ef0beb5f14acc88818436fa60a170', 'request_id': 'req-2a9ec528-91e2-446b-893a-fe942304c54e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:33.271075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65ef0beb5f14acc88818436fa60a170', 'request_id': 'req-2a9ec528-91e2-446b-893a-fe942304c54e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:33.355888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] The token cache is being invalidate because project e65ef0beb5f14acc88818436fa60a170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:33.356903 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:33.363464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2a9ec528-91e2-446b-893a-fe942304c54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:33.365182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1149/2331] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:32 2022] DELETE /identity/v3/projects/e65ef0beb5f14acc88818436fa60a170 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:33.370274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.375779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.375779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.409641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:33.413677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:33.532452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.532750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.533036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.533894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1183/2332] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:33.573096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:33.574735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:33.586845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1150/2333] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:33.590846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:33.619590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0974-985d-4b81-b539-6178cd9a8470 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:33.629219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:33.630056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.630516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.636832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.638091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:33.638514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:33.640243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:33.719012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1184/2334] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:33.724498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:33.739264 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82db5c-4337-4afa-a586-2f7e7489184c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:33.750427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:33.751629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.756051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.756051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.756051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:33.767926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:33.887036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:33.891699 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:33.908199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0511a38-f5f7-4513-8ba1-6b98f224f998 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:33.929234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:33.929234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:33.929234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:33.929234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] PATH_INFO: `/v3/users/13a4a8034fb84afe82a2248248e23f93` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:33.929595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1151/2335] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:33 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:23:33.929691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a4a8034fb84afe82a2248248e23f93)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:33.929691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:33.930284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.047197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:34.069929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cbf0-7a94-4111-8132-02f366a806e6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.079552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.082374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.083813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.084583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.086182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.090178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.240343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1152/2336] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:33 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:34.241850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.257331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a4a8034fb84afe82a2248248e23f93'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:34.269918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fe0b-189e-4151-b411-044a572dfe37 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.278459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.279560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.280753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.281258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.282209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.284935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.300019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1153/2337] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:34.301220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.315990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a580a-890d-42f4-bee8-7a4e2ba424eb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.321426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.322299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.322817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.323283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.324045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.326391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.338388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1154/2338] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:34.343191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.356460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a1f7-e76a-400c-be66-f8b705d900f8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.363561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.365111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.365473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.365819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] PATH_INFO: `/v3/projects/e39d755b7ed9488ebe99c5ea01c633b5/users/e3e014c2334c4b6aab08eb2e05f16ba8/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.389431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39d755b7ed9488ebe99c5ea01c633b5, user_id=e3e014c2334c4b6aab08eb2e05f16ba8, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.393988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8f43-0349-4151-b7ad-aeb0e078fa43 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.394696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a4a8034fb84afe82a2248248e23f93'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:34.395422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a4a8034fb84afe82a2248248e23f93'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:34.406032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a4a8034fb84afe82a2248248e23f93'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:34.427198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-ac548272-2165-47e3-a1f6-1fac1405b95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a4a8034fb84afe82a2248248e23f93'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:34.441803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1185/2339] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:33 2022] DELETE /identity/v3/users/13a4a8034fb84afe82a2248248e23f93 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:34.446367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188118-4d22-44fa-be66-2beac067545e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.446879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188118-4d22-44fa-be66-2beac067545e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.447166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188118-4d22-44fa-be66-2beac067545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.478101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-22188118-4d22-44fa-be66-2beac067545e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:34.479446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-22188118-4d22-44fa-be66-2beac067545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:34.496238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:34.521202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1155/2340] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:34 2022] PUT /identity/v3/projects/e39d755b7ed9488ebe99c5ea01c633b5/users/e3e014c2334c4b6aab08eb2e05f16ba8/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:34.537328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.537758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.538156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.562797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1186/2341] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:34.575464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188118-4d22-44fa-be66-2beac067545e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.578760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-22188118-4d22-44fa-be66-2beac067545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:34.582608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] MFA Rules not processed for user `e3e014c2334c4b6aab08eb2e05f16ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:34.583774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:34.673196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1156/2342] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:34.674287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188118-4d22-44fa-be66-2beac067545e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.687128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.691090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:34.755564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.756242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.756986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.757275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.802767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368cc6b-a36e-4836-90aa-d7b258663a20 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:34.808302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:34.809901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:34.810270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:34.810641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:34.811410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.813916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.870899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:34.873711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:34.896723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1187/2343] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:34.918481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1157/2344] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:34 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:23:34.928997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:34.942358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fafab-a386-4e9b-99cd-e2b7cb093de1 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.025063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.025909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.026302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.026734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.027656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.030390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1edf-472c-4259-9ccc-c144e5aaee34 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.140247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1188/2345] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:34 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:35.144757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.179044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b03f11-675a-4c82-a998-8b46ecc4bca3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.204803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.204946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.206516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.206624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.207375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.209015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.229942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.230618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.230618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.256383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1158/2346] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:35.266363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.284777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] MFA Rules not processed for user `7c0a6a51b0dc4d439c7734fe47b026f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:35.286593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:35.291201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8871009-7506-4fbd-a801-4f5924c578e1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.325873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.330798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.331096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.334860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] PATH_INFO: `/v3/projects/8fee7e53570b45159821cd008c4ff7fa/users/9e9b845a17ec4b2b9066843a0173f92a/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.390953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fee7e53570b45159821cd008c4ff7fa, user_id=9e9b845a17ec4b2b9066843a0173f92a, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.394137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.434270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1189/2347] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:35.449357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.451499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:35.530081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1159/2348] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:35 2022] PUT /identity/v3/projects/8fee7e53570b45159821cd008c4ff7fa/users/9e9b845a17ec4b2b9066843a0173f92a/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:35.534373 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.637910 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c7c7-6492-4c62-a4dd-550b33a32fae None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.660518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c076-e8a9-42b5-973e-6aa973fa6555 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.669513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.670442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.671381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.671788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.672790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.675900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.689288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1160/2349] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:35.693384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.705634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff581c2-4cd8-48c4-8796-50f7baf51eee admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:35.713453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.715677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.716136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.716758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] PATH_INFO: `/v3/projects/8fee7e53570b45159821cd008c4ff7fa/users/9e9b845a17ec4b2b9066843a0173f92a/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.720567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fee7e53570b45159821cd008c4ff7fa, user_id=9e9b845a17ec4b2b9066843a0173f92a, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.723407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a20d08-fa6e-47a6-8766-0153d348368c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.744940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1161/2350] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:35 2022] PUT /identity/v3/projects/8fee7e53570b45159821cd008c4ff7fa/users/9e9b845a17ec4b2b9066843a0173f92a/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:35.745313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:35.745313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.745313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.745313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.745990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:35.747337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:35.747639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:35.748069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:35.805529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] MFA Rules not processed for user `9e9b845a17ec4b2b9066843a0173f92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:35.807555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:35.817882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:35.894434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:35.899506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:35.918112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1162/2351] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:35.921038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.924708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1190/2352] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:35.928200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:35.939758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:35.949030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:36.081232 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a65d-f3b0-49c8-b4bb-7502b314b780 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:36.085458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:36.095065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc21e-1e4c-4a37-a6e1-6f3dacf405da None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:36.105364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:36.106341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.107168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.107468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] PATH_INFO: `/v3/projects/17d78571398b43b9a754e627bf908a1f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.108753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d78571398b43b9a754e627bf908a1f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:36.111089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:36.168794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:36.169529 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.169816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.170093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.187863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:36.201651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:36.233811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1191/2353] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:36.340883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d78571398b43b9a754e627bf908a1f', 'request_id': 'req-c935cde5-266f-425d-97a5-96b839027a57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:36.346347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d78571398b43b9a754e627bf908a1f', 'request_id': 'req-c935cde5-266f-425d-97a5-96b839027a57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:36.352786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d78571398b43b9a754e627bf908a1f', 'request_id': 'req-c935cde5-266f-425d-97a5-96b839027a57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:36.473899 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:36.483837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0091ac-f314-41ca-866d-150eff04ff68 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:36.540812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] The token cache is being invalidate because project 17d78571398b43b9a754e627bf908a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:36.541171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:36.541813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c935cde5-266f-425d-97a5-96b839027a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:36.547673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1163/2354] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:35 2022] DELETE /identity/v3/projects/17d78571398b43b9a754e627bf908a1f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:36.549179 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590fb3-f565-478a-9217-93729517803f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.549533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590fb3-f565-478a-9217-93729517803f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.550248 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590fb3-f565-478a-9217-93729517803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.571802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:36.572479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.572774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.573059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.581985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:36.586714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a6590fb3-f565-478a-9217-93729517803f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:36.587950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a6590fb3-f565-478a-9217-93729517803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:36.707688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:36.709729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9783-4dab-4fb8-8588-1357c4cbd382 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:36.722704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1192/2355] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:23:36.733226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1164/2356] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:36.734772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.735071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.735355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.762264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:36.764183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:36.775681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1193/2357] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:36.779981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590fb3-f565-478a-9217-93729517803f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:36.804878 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590fb3-f565-478a-9217-93729517803f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:36.832681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:36.835729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.835729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.835729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.835729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:36.835729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:36.838949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:36.858631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:36.886889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1165/2358] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:36.892189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:36.906804 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826a97-391a-4267-bbc8-6f4abf6fa66e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:36.914343 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:36.915048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:36.915333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:36.915687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:36.916440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:36.918549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:37.025800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1194/2359] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:36 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:37.029584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.044908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dcfc1-dbda-400d-91bf-c91033814aca admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:37.185269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:37.186337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.187595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.188091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.189139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:37.191582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:37.268785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:37.329569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1166/2360] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:37 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:37.341494 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.362737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae609-060f-4ca5-b664-33b91b843d84 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:37.370538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:37.371413 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.371769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.372120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.372968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:37.374705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:37.398769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1195/2361] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:37.400035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.417261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3216-8b30-4e99-8a0b-25d521c22daf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:37.429620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:37.430708 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.431204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.431774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.432887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:37.435850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:37.456940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.462303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1167/2362] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:37.468521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5cf58-1c9a-4179-ac87-04dc26ae328f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:37.474868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:37.476394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.476855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.479989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] PATH_INFO: `/v3/projects/8ff83c0d6d204e408cad74aebdea92e1/users/94843b7509684aff958295869d0202da/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.497770 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff83c0d6d204e408cad74aebdea92e1, user_id=94843b7509684aff958295869d0202da, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:37.500489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fad9f-c18a-4533-a0a4-2ec118de34b7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:37.540978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.543056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:37.580901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f7f5-23a2-4c5d-8697-ccbf3341789c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:37.585701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1196/2363] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:37 2022] PUT /identity/v3/projects/8ff83c0d6d204e408cad74aebdea92e1/users/94843b7509684aff958295869d0202da/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:37.592768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.592768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.593076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.660868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] MFA Rules not processed for user `94843b7509684aff958295869d0202da`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:37.663245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:37.844241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1197/2364] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:37.896073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:37.898068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:37.917893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:37.919588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:37.920063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:37.920527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] PATH_INFO: `/v3/users/e3e014c2334c4b6aab08eb2e05f16ba8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:37.934495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e014c2334c4b6aab08eb2e05f16ba8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:37.953625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.027971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603f6c3-323d-4dce-89a4-77181d84d71b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:38.032887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:38.036964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.036964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.036964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] PATH_INFO: `/v3/users/b48262b92d274751b1da492d403358df` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.036964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48262b92d274751b1da492d403358df)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:38.037598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.184478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e014c2334c4b6aab08eb2e05f16ba8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.185779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e014c2334c4b6aab08eb2e05f16ba8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.297755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e014c2334c4b6aab08eb2e05f16ba8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.298396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e014c2334c4b6aab08eb2e05f16ba8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.313062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e014c2334c4b6aab08eb2e05f16ba8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.326258 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48262b92d274751b1da492d403358df'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.331439 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1168/2365] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:37 2022] DELETE /identity/v3/users/e3e014c2334c4b6aab08eb2e05f16ba8 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:38.332748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:38.334649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.397700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef5eb9-1bcc-4bb5-8550-adc8eff0f379 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:38.401539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:38.402274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.403196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.403543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.405663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.422934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48262b92d274751b1da492d403358df'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.424709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48262b92d274751b1da492d403358df'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.447992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48262b92d274751b1da492d403358df'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.468152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0bab4a43-371f-4c6c-b063-e1fdc40a2890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48262b92d274751b1da492d403358df'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.474444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1198/2366] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:37 2022] DELETE /identity/v3/users/b48262b92d274751b1da492d403358df => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:38.475889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.476470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.476470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.491442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:38.492835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41abc4-edaa-4f7f-94ed-ba5613205e6e service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.497309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:38.498804 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.506231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1169/2367] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:38.508087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.508715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.509643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.566543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:38.569367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.611713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1199/2368] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:38.616061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:38.617534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.632459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff871-ccbd-4416-a39b-675e268f8d71 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:38.640118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:38.641680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.641974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.642255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] PATH_INFO: `/v3/users/94843b7509684aff958295869d0202da` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.644380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94843b7509684aff958295869d0202da)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:38.646908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.689540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1170/2369] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:38.690616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:38.694005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:38.702820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:38.779999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9458-6ccb-4801-bb29-5ab66fb0de4d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:38.784886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:38.785485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.785807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.786125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.801429 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:38.803167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.816041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1171/2370] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:38.817039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:38.832951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c8ae7-019b-42c3-a90f-433ff9fcc025 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:38.844022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:38.845438 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.845782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.847288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:38.863446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:38.865044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe45c85-5652-471b-b77c-a399c981d05d service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:38.885682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1172/2371] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:38.942373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94843b7509684aff958295869d0202da'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:38.969932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:38.971236 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:38.971710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:39.079777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94843b7509684aff958295869d0202da'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:39.080464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94843b7509684aff958295869d0202da'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:39.090998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94843b7509684aff958295869d0202da'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:39.094898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:39.096217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:39.119379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d85c3d61-b99f-4d79-a7c2-73dc5180cb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94843b7509684aff958295869d0202da'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:39.127409 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1200/2372] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:38 2022] DELETE /identity/v3/users/94843b7509684aff958295869d0202da => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:39.134359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:39.134685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:39.134977 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:39.192422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:39.197256 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:39.211901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1173/2373] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:39.264028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:39.284667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:39.286950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:39.317546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1201/2374] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:39.395536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:39.406151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:39.533645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:39.569008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c7c23-3896-4f49-b02b-d74b5eb15be7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:39.577568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:39.580203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:39.580203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:39.580203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:39.580535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e591-ce23-4728-8afe-bdaa372c8de1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:39.593736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:39.596104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:39.610038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1202/2375] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:39.652020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:39.653505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:39.654079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:39.654165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:39.749052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:39.751242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:39.762634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1174/2376] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 15:23:39.971327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:39.972874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:39.994341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4a43d-3411-4560-bfb9-ad61836b5ac2 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:40.008618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:40.010049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.012631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.013308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] PATH_INFO: `/v3/projects/e39d755b7ed9488ebe99c5ea01c633b5` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.016044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39d755b7ed9488ebe99c5ea01c633b5)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:40.021030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:40.030275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:40.035535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:40.070251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608b19c-7a5d-46b9-aa9e-eeedfdba216d service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:40.089471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:40.089471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.089471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.089471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] PATH_INFO: `/v3/projects/9d7c90da947e40aa831cfd2957995745` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.093693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7c90da947e40aa831cfd2957995745)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:40.096162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:40.222320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39d755b7ed9488ebe99c5ea01c633b5', 'request_id': 'req-26a8e321-cb68-42ae-a7bb-0bda2776017d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.290597 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7c90da947e40aa831cfd2957995745', 'request_id': 'req-0b275cc8-7587-4f7d-84de-e4f89f9ea421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.299696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7c90da947e40aa831cfd2957995745', 'request_id': 'req-0b275cc8-7587-4f7d-84de-e4f89f9ea421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.313396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39d755b7ed9488ebe99c5ea01c633b5', 'request_id': 'req-26a8e321-cb68-42ae-a7bb-0bda2776017d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.317034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7c90da947e40aa831cfd2957995745', 'request_id': 'req-0b275cc8-7587-4f7d-84de-e4f89f9ea421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.327402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39d755b7ed9488ebe99c5ea01c633b5', 'request_id': 'req-26a8e321-cb68-42ae-a7bb-0bda2776017d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.358985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] The token cache is being invalidate because project e39d755b7ed9488ebe99c5ea01c633b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:40.359658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.360486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.363026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1203/2377] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:39 2022] DELETE /identity/v3/projects/e39d755b7ed9488ebe99c5ea01c633b5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:40.367408 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:40.369146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:40.457512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] The token cache is being invalidate because project 9d7c90da947e40aa831cfd2957995745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:40.458204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.482235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-0b275cc8-7587-4f7d-84de-e4f89f9ea421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:40.498751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1175/2378] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:40 2022] DELETE /identity/v3/projects/9d7c90da947e40aa831cfd2957995745 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:40.504727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1968fe-7bce-45b9-a989-caffa6e87d92 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.507215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1968fe-7bce-45b9-a989-caffa6e87d92 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.509560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1968fe-7bce-45b9-a989-caffa6e87d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.568368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dc1968fe-7bce-45b9-a989-caffa6e87d92 None None] MFA Rules not processed for user `57076420f7ed4d3e88ab61ccd3208d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:40.571013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dc1968fe-7bce-45b9-a989-caffa6e87d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:40.640264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e321-cb68-42ae-a7bb-0bda2776017d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:40.794598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1176/2379] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:40.796115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.797603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.797811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.881791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:40.883199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:40.890274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:40.900292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.900968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.900968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] PATH_INFO: `/v3/users/9e9b845a17ec4b2b9066843a0173f92a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.914630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9b845a17ec4b2b9066843a0173f92a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:40.915266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1177/2380] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:40.919240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:40.924331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:40.927915 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:40.969309 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4df31-3c8f-4a64-8e84-d1b0ee5fff82 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:40.978801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:40.979904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:40.980381 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:40.982255 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] PATH_INFO: `/v3/projects/8ff83c0d6d204e408cad74aebdea92e1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:40.983720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff83c0d6d204e408cad74aebdea92e1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:40.986487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:41.096716 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:41.182475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff83c0d6d204e408cad74aebdea92e1', 'request_id': 'req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.191217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9b845a17ec4b2b9066843a0173f92a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.197318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff83c0d6d204e408cad74aebdea92e1', 'request_id': 'req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.223724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff83c0d6d204e408cad74aebdea92e1', 'request_id': 'req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.268960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9b845a17ec4b2b9066843a0173f92a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.269589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9b845a17ec4b2b9066843a0173f92a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.283991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9b845a17ec4b2b9066843a0173f92a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.309101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a59fbb0-8715-4d99-b7d7-97d24f2d4d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9b845a17ec4b2b9066843a0173f92a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.327010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1204/2381] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:40 2022] DELETE /identity/v3/users/9e9b845a17ec4b2b9066843a0173f92a => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:41.331662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:41.332171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:41.332613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:41.377945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] The token cache is being invalidate because project 8ff83c0d6d204e408cad74aebdea92e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:41.400353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.400353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:41.400737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:41.400737 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:41.400928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1178/2382] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:40 2022] DELETE /identity/v3/projects/8ff83c0d6d204e408cad74aebdea92e1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:41.530505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1205/2383] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:41.535212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:41.683522 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2a7f-b8fb-4edc-8c8a-1072b1f531bd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:41.692008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:41.692754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:41.693040 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:41.693315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:41.694049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:41.694358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:41.699652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:41.718961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1179/2384] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:23:41.720921 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:41.737231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9955c84-917e-4616-b37c-d30d2fe61243 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:41.764179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:41.768419 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:41.768919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:41.769416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:41.771609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:41.772114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06be1-df6f-46a3-a886-38ce10f71993 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:41.784487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:41.887597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1206/2385] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:41.898104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:41.920630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238453-a001-4f50-91a5-db7875060b67 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.019348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.020328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.020620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.020896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.021583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.023642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.074949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.074949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.074949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.106032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:42.109184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.214160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1180/2386] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:41 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:42.223109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.245230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5224-32ab-4889-ad76-2425e9093064 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.261050 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.265558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.265558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.266294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.269425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.273153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.300307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1181/2387] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:42.305105 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.310669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.324835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1207/2388] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:42.326464 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.338461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24e3d-4758-401f-9239-c45445ebb330 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.346133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.347401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.347851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.348319 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] PATH_INFO: `/v3/projects/8fee7e53570b45159821cd008c4ff7fa` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.349846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fee7e53570b45159821cd008c4ff7fa)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.352409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.357536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e113c09-f079-4ff3-8c6e-906bb5221661 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.369385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.370207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.370655 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.370927 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.371926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.373577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.401847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1208/2389] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:42.401847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.401847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.496454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fee7e53570b45159821cd008c4ff7fa', 'request_id': 'req-fbff4855-f680-45f2-a6ec-870d4b99e428'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:42.504795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7d42-38ee-4c41-ac71-27ff531b3c6b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.507430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fee7e53570b45159821cd008c4ff7fa', 'request_id': 'req-fbff4855-f680-45f2-a6ec-870d4b99e428'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:42.517136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fee7e53570b45159821cd008c4ff7fa', 'request_id': 'req-fbff4855-f680-45f2-a6ec-870d4b99e428'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:42.576701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.576701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.576701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.576701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.602805 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] The token cache is being invalidate because project 8fee7e53570b45159821cd008c4ff7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:42.603100 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:42.606274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:42.611020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1182/2390] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:42 2022] DELETE /identity/v3/projects/8fee7e53570b45159821cd008c4ff7fa => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:42.613690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.617219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.697471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.700711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebeda2-6ee6-443c-a3a9-1565b4a29252 service swift] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.718752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1209/2391] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:23:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:23:42.721825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b7b-784b-4add-a3d8-5c4a9b9b085d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.723617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b7b-784b-4add-a3d8-5c4a9b9b085d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.724828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b7b-784b-4add-a3d8-5c4a9b9b085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.770008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b2915b7b-784b-4add-a3d8-5c4a9b9b085d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:42.774321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4855-f680-45f2-a6ec-870d4b99e428 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.783879 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b2915b7b-784b-4add-a3d8-5c4a9b9b085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.793753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.795027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.795406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.795689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] PATH_INFO: `/v3/projects/0219d3f2632c43b2984b8b398ad445c6/users/b7931ec0b42042e6bd899e0006e3d23e/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.799614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1210/2392] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:42.813147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.820166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.840706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.841353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0219d3f2632c43b2984b8b398ad445c6, user_id=b7931ec0b42042e6bd899e0006e3d23e, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.852656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673b1ea-5d0b-4532-acbd-95c707f79ad6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:42.892203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:42.893533 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:42.917242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1211/2393] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:42.922823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:42.943943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6bde-0906-4b24-aaef-c790794572ce None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:42.959473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1183/2394] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:42 2022] PUT /identity/v3/projects/0219d3f2632c43b2984b8b398ad445c6/users/b7931ec0b42042e6bd899e0006e3d23e/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:42.970611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:42.970611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.970611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.971947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:42.972610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:42.972697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.978331 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:42.979211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:42.979498 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:42.981687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.012577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1212/2395] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:23:43.014165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.036808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] MFA Rules not processed for user `b7931ec0b42042e6bd899e0006e3d23e`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:43.040445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:43.049112 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb86a6-6399-473f-bf39-04defd77756d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.160632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.161403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.161800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.162189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.163059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.165768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.265304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1184/2396] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:43.276302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1213/2397] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:43 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:43.278864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.280669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.282486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:43.382396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d5cc-7bd1-4a0e-97e2-aed1cfddd0b6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.469670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:43.509500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba382b9f-6c4c-4712-854d-4b4a119ce5f2 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.533282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.535733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.536751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.537132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.538334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.541277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.544564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.545987 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.546533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.547047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.671093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1214/2398] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:43 2022] POST /identity/v3/users => generated 286 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:43.679546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.693389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:43.713542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0310-7d95-413a-97e1-6b6ec5bdf89c admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.726961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.727698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.727920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.734579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.738698 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.743208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.754276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.757203 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.769714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1185/2399] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:43.786918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.798974 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1215/2400] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:43.816899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49095-d644-499e-abba-b7426c7b5ff8 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.823680 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.827427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.827791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.828159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.829352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.832553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676df80-c97d-4c83-afd7-e197fbe9c8d4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:43.858642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1186/2401] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:23:43.862379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:43.876396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc69122-18aa-4487-920d-ee5708f68b53 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:43.895639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:43.900682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:43.901683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:43.901894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] PATH_INFO: `/v3/projects/ccd92d484dea4fcc81c44ade2a2912e4/users/83fc09975a3b475a9fd3d2a4b82dab53/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:43.903288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:43.956763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd92d484dea4fcc81c44ade2a2912e4, user_id=83fc09975a3b475a9fd3d2a4b82dab53, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:43.974712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:44.232830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1216/2402] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:43 2022] PUT /identity/v3/projects/ccd92d484dea4fcc81c44ade2a2912e4/users/83fc09975a3b475a9fd3d2a4b82dab53/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:44.256609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:44.257129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:44.257370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:44.343660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:44.363388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] MFA Rules not processed for user `83fc09975a3b475a9fd3d2a4b82dab53`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:44.364654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:44.401236 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:44.512919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1187/2403] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:44.517597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:44.772855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d372f-d3d6-47e7-a6f6-68902171433a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:44.786693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:44.787389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:44.787673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:44.787950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:44.788656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:44.794059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:44.935274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1217/2404] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:44 2022] POST /identity/v3/projects => generated 373 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:44.942388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:44.966119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d369b-c0fe-4369-84af-df0de2c3a149 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:45.142724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:45.143722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:45.144166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:45.144955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:45.148565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:45.163759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:45.341167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1188/2405] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:44 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:45.345410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:45.368447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853b20-b4ba-485f-9c9f-9cb1a553c686 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:45.383851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:45.385967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:45.386368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:45.386874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:45.387745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:45.390894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:45.411622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1218/2406] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:45.415390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:45.443857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:45.493131 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0bda-e195-486e-a10e-adf8f165828b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:45.498274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:45.509285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:45.512357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:45.512701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:45.513776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] PATH_INFO: `/v3/projects/154c180248da48c68febb9d6549772ee/users/724ce9d1649a435ba544090d343beb84/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:45.595487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154c180248da48c68febb9d6549772ee, user_id=724ce9d1649a435ba544090d343beb84, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:45.610145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:45.716732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1189/2407] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:45 2022] PUT /identity/v3/projects/154c180248da48c68febb9d6549772ee/users/724ce9d1649a435ba544090d343beb84/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:45.722030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:45.741894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f699-00a0-48b5-a505-b5c7cb494145 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:45.880398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:45.882612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:45.884086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:45.884643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:45.888536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:45.893645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f7ffa-8e97-4bd4-9fe6-9ffcc1d4ec23 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:45.939665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1219/2408] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:45.944687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:45.957707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dad5-8c7f-4a85-9716-d8d77aa9d752 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:45.966730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:45.968060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:45.968457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:45.968898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] PATH_INFO: `/v3/projects/154c180248da48c68febb9d6549772ee/users/724ce9d1649a435ba544090d343beb84/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:45.972180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] RBAC: Authorizing `identity:create_grant(project_id=154c180248da48c68febb9d6549772ee, user_id=724ce9d1649a435ba544090d343beb84, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:45.975782 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:45.992387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1190/2409] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:45 2022] PUT /identity/v3/projects/154c180248da48c68febb9d6549772ee/users/724ce9d1649a435ba544090d343beb84/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:46.003469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b108-d06e-47e5-be4a-9b7895d65193 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:46.008453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b108-d06e-47e5-be4a-9b7895d65193 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:46.008453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b108-d06e-47e5-be4a-9b7895d65193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:46.056420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0c91b108-d06e-47e5-be4a-9b7895d65193 None None] MFA Rules not processed for user `724ce9d1649a435ba544090d343beb84`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:46.057823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0c91b108-d06e-47e5-be4a-9b7895d65193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:46.229759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1220/2410] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:46.235024 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:46.316854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a7b5-1f40-4515-ac05-b5ebb63a052e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:46.321861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:46.333164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:46.333164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:46.333164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:46.408538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:46.411121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:46.423775 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1191/2411] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:23:46.533009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:46.565576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:46.626461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b37d-f7ae-49dd-ba74-b27355d8014e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:46.626461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b37d-f7ae-49dd-ba74-b27355d8014e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:46.627143 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b37d-f7ae-49dd-ba74-b27355d8014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:46.680062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7228b37d-f7ae-49dd-ba74-b27355d8014e None None] MFA Rules not processed for user `b7931ec0b42042e6bd899e0006e3d23e`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:46.687291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7228b37d-f7ae-49dd-ba74-b27355d8014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:46.816515 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1221/2412] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:46.932063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:47.407092 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:51.415363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:51.487499 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:51.629631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ccea0-9b9e-45b8-8259-23ad80244986 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:51.640228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:51.673129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:51.673129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:51.673129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] PATH_INFO: `/v3/users/83fc09975a3b475a9fd3d2a4b82dab53` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:51.673129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fc09975a3b475a9fd3d2a4b82dab53)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:51.673129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:52.059005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fc09975a3b475a9fd3d2a4b82dab53'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:52.066368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fc09975a3b475a9fd3d2a4b82dab53'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:52.194398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fc09975a3b475a9fd3d2a4b82dab53'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:52.195191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fc09975a3b475a9fd3d2a4b82dab53'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:52.229362 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fc09975a3b475a9fd3d2a4b82dab53'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:52.260812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1192/2413] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:51 2022] DELETE /identity/v3/users/83fc09975a3b475a9fd3d2a4b82dab53 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:52.289785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:52.289785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:52.289785 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:52.352479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:52.361284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:52.470937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:52.522624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1222/2414] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:52.539498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:52.547242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:52.745405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505dc8-c001-4ad1-af4d-cb356b2f5dfb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:52.750526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:52.751415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:52.752139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:52.754250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:52.777921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:52.780422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f793c-66e8-4a39-ad3f-cefe01fae368 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:52.812266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1193/2415] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:23:54.217089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:54.218768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:54.240446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:54.244300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:54.244794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:54.276548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1114-1a5e-428e-b2ca-27cba0218c90 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:54.283566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] MFA Rules not processed for user `5391ed1b9b0b4a01bd2bc9351e2bd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:54.285047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:54.294534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:54.296340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:54.296884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:54.297457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] PATH_INFO: `/v3/projects/ccd92d484dea4fcc81c44ade2a2912e4` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:54.300517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd92d484dea4fcc81c44ade2a2912e4)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:54.302878 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:54.360618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:54.381591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1194/2416] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:54.431621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd92d484dea4fcc81c44ade2a2912e4', 'request_id': 'req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:54.510887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd92d484dea4fcc81c44ade2a2912e4', 'request_id': 'req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:54.523352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd92d484dea4fcc81c44ade2a2912e4', 'request_id': 'req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:54.572361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] The token cache is being invalidate because project ccd92d484dea4fcc81c44ade2a2912e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:54.573049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:54.573367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:54.575831 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1223/2417] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:54 2022] DELETE /identity/v3/projects/ccd92d484dea4fcc81c44ade2a2912e4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:54.580035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:54.598665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c06ac-ab9a-4d05-a7ae-74f7a8301ed6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:54.702669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:54.703860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:54.704338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:54.704958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] PATH_INFO: `/v3/users/724ce9d1649a435ba544090d343beb84` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:54.710343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724ce9d1649a435ba544090d343beb84)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:54.715028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:55.224899 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724ce9d1649a435ba544090d343beb84'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:55.226096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724ce9d1649a435ba544090d343beb84'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:55.607393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724ce9d1649a435ba544090d343beb84'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:55.609929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724ce9d1649a435ba544090d343beb84'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:55.645616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e45d0cc9-7e10-4581-9515-ef82e6f34d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724ce9d1649a435ba544090d343beb84'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:55.665094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1195/2418] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:23:54 2022] DELETE /identity/v3/users/724ce9d1649a435ba544090d343beb84 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:23:56.267955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:56.271416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:56.298369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90b24c-9a8e-4d7d-8225-a1d4aea53d8a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:56.475604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:56.476523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:56.476817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:56.477339 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] PATH_INFO: `/v3/projects/154c180248da48c68febb9d6549772ee` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:56.478584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154c180248da48c68febb9d6549772ee)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:56.480626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:56.889517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154c180248da48c68febb9d6549772ee', 'request_id': 'req-2fa6bfe5-8595-4079-b469-af0bd06f5060'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:56.976738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154c180248da48c68febb9d6549772ee', 'request_id': 'req-2fa6bfe5-8595-4079-b469-af0bd06f5060'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:56.995538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154c180248da48c68febb9d6549772ee', 'request_id': 'req-2fa6bfe5-8595-4079-b469-af0bd06f5060'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:57.028412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:57.037561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] The token cache is being invalidate because project 154c180248da48c68febb9d6549772ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:23:57.038024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:57.040768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2fa6bfe5-8595-4079-b469-af0bd06f5060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:23:57.043269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1224/2419] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:23:56 2022] DELETE /identity/v3/projects/154c180248da48c68febb9d6549772ee => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:57.048908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.050616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.051228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.081052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:57.082611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:57.194441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1196/2420] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:57.205511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.205918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.206193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.232579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:57.237275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:57.256140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.264657 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1225/2421] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:23:57.268925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6bc4e-5e6d-41cc-abe0-946ac870574b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.277180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.278945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.279328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.279575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.284703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:23:57.285469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.287476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:57.311907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1197/2422] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:23:57.317361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.337690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969562e6-3e63-4e7a-804e-d931ac884ae5 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.344949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.345686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.345972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.346382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.347131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.349194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:57.455645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1226/2423] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:23:57 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:57.460652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.481696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9893e-fdb7-4b8b-a476-60c76e3604d9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.499595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:57.643687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.644721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.645141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.645426 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.646390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.649291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:57.834864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1198/2424] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:23:57 2022] POST /identity/v3/users => generated 285 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:23:57.840176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.852197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c3f2-657f-4763-a07f-52248359a90b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.865959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.866781 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.867140 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.867482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.868312 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.869986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:57.888089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1227/2425] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:23:57.890666 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.900355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e765f-9008-47bc-9004-9b319f7ff98d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.925664 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.926512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.926869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.927078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.928197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.929773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fe6d5-e26d-4af1-a4df-73386d88dbe6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:57.946456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1199/2426] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:23:57.952006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:57.963010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94602-bcbe-4828-bd88-24c99c2a6992 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:57.968946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:57.969881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:57.970444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:57.970746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] PATH_INFO: `/v3/projects/74f0b74f53e542918731bbc0950878c7/users/478d19cf2d074ca2afec7d31dad45067/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:57.987690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f0b74f53e542918731bbc0950878c7, user_id=478d19cf2d074ca2afec7d31dad45067, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:57.990268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:58.070357 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1228/2427] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:23:57 2022] PUT /identity/v3/projects/74f0b74f53e542918731bbc0950878c7/users/478d19cf2d074ca2afec7d31dad45067/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:23:58.143263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3a2-4007-44d6-b299-b522d6dd8805 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:58.143828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3a2-4007-44d6-b299-b522d6dd8805 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:58.144066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3a2-4007-44d6-b299-b522d6dd8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:58.173399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c6e2e3a2-4007-44d6-b299-b522d6dd8805 None None] MFA Rules not processed for user `478d19cf2d074ca2afec7d31dad45067`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:23:58.175114 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c6e2e3a2-4007-44d6-b299-b522d6dd8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:58.274197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1200/2428] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:23:58.384593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:23:58.386894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:23:58.483743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31af-8be4-493d-874d-489394ce4040 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:23:58.487493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:23:58.488165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:23:58.488458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:23:58.488728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:23:58.498371 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:23:58.499859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a69f70-a99a-47bf-9b81-431d2d63809f service glance] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:23:58.514532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1229/2429] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:05.316332 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100909-14c6-453a-832e-2112e921d80d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.317488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100909-14c6-453a-832e-2112e921d80d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.317945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100909-14c6-453a-832e-2112e921d80d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.319395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1201/2430] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:24:05.329474 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039da46-b080-4731-a1b8-c12a6674aa80 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.335615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039da46-b080-4731-a1b8-c12a6674aa80 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.335615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039da46-b080-4731-a1b8-c12a6674aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.391375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6039da46-b080-4731-a1b8-c12a6674aa80 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:05.392998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6039da46-b080-4731-a1b8-c12a6674aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:05.510253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:05.530485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1230/2431] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:24:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:05.561156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100909-14c6-453a-832e-2112e921d80d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:05.564801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fb100909-14c6-453a-832e-2112e921d80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:05.581785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100909-14c6-453a-832e-2112e921d80d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:05.586198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:05.586926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.587220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.587488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.602266 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:05.603795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc06612-bddf-4056-96ce-cbbff3dae36c service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:05.618592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1202/2432] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:05.813075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.813374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.813664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] PATH_INFO: `/` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.815126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1231/2433] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:24:05.820087 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9189e9-6c48-4cf8-aae5-e61294980c67 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.820446 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9189e9-6c48-4cf8-aae5-e61294980c67 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.820788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9189e9-6c48-4cf8-aae5-e61294980c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.855517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9c9189e9-6c48-4cf8-aae5-e61294980c67 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:05.857064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9c9189e9-6c48-4cf8-aae5-e61294980c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:05.920757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1203/2434] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:24:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:05.938439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:05.940306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:05.957788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589459a0-2a0b-4f05-9007-dc019e5d22a3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:05.961379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:05.962030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:05.962315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:05.962838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:05.974696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:05.974696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971b42-fb5a-4b45-a68e-8797319ff907 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:05.982514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1232/2435] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:06.104889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841aa5-12c7-496b-978d-ee2ecabf7e50 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:06.105183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841aa5-12c7-496b-978d-ee2ecabf7e50 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:06.105460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841aa5-12c7-496b-978d-ee2ecabf7e50 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:06.106900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1204/2436] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:24:06.112475 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd89-4cb4-47bd-a693-9748b1ad94fd None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:06.112766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd89-4cb4-47bd-a693-9748b1ad94fd None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:06.113067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd89-4cb4-47bd-a693-9748b1ad94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:06.132718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0d50cd89-4cb4-47bd-a693-9748b1ad94fd None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:06.134032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0d50cd89-4cb4-47bd-a693-9748b1ad94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:06.143644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1233/2437] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:06.168807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841aa5-12c7-496b-978d-ee2ecabf7e50 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:06.180246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841aa5-12c7-496b-978d-ee2ecabf7e50 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:06.184242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:06.184888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:06.185172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:06.185445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:06.200096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:06.212863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:06.225645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:06.243300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1205/2438] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:15.652124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a820-5a0b-4dca-ab1c-564bee074dae None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:15.652601 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a820-5a0b-4dca-ab1c-564bee074dae None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:15.652681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a820-5a0b-4dca-ab1c-564bee074dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:15.671873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-4bd9a820-5a0b-4dca-ab1c-564bee074dae None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:15.673097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4bd9a820-5a0b-4dca-ab1c-564bee074dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:15.731262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1234/2439] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:24:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:15.743515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:15.744940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:15.839764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe972e-71eb-48e9-a206-b9e48cdca8ee service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:15.845111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:15.845797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:15.846084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:15.846364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:15.855539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:15.857424 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:15.869210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1206/2440] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 15:24:18.102712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:18.103179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:18.103364 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:18.121864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:18.123099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:18.131184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1235/2441] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:24:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:18.142807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:18.153302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995d15-42a8-476b-8948-c4f71bd4125d service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:18.158483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:18.159116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:18.159428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:18.159707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:18.167662 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:18.169235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:18.177898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1207/2442] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:24:19.236425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:19.238028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:19.382425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f00329-bc33-4358-80c2-f8aab8b43fe4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:19.387455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:19.388354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:19.388645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:19.388924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] PATH_INFO: `/v3/users/f51fcc2493544ba381fe05c979302c04` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:19.391513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51fcc2493544ba381fe05c979302c04)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:19.393592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:19.633260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51fcc2493544ba381fe05c979302c04'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:19.706782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51fcc2493544ba381fe05c979302c04'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:19.708066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51fcc2493544ba381fe05c979302c04'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:19.717734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51fcc2493544ba381fe05c979302c04'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:19.732068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:19.736652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4f598238-d97f-4c69-ae96-28dadaafc969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51fcc2493544ba381fe05c979302c04'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:19.745388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1236/2443] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:24:19 2022] DELETE /identity/v3/users/f51fcc2493544ba381fe05c979302c04 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:20.052757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:20.088601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239bc7-3eb2-4c21-b5dc-b4c4a7dd9038 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:20.189562 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:20.190479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:20.190767 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:20.191053 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] PATH_INFO: `/v3/projects/fa3aec8abfae4d17a3155badc42b4780` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:20.192470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3aec8abfae4d17a3155badc42b4780)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:20.194911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:20.565152 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3aec8abfae4d17a3155badc42b4780', 'request_id': 'req-88966be0-89fb-4a69-954f-a4eefe0dacba'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:20.574615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3aec8abfae4d17a3155badc42b4780', 'request_id': 'req-88966be0-89fb-4a69-954f-a4eefe0dacba'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:20.583316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3aec8abfae4d17a3155badc42b4780', 'request_id': 'req-88966be0-89fb-4a69-954f-a4eefe0dacba'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:20.638007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] The token cache is being invalidate because project fa3aec8abfae4d17a3155badc42b4780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:24:20.638531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:20.639246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-88966be0-89fb-4a69-954f-a4eefe0dacba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:20.641886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1208/2444] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:24:20 2022] DELETE /identity/v3/projects/fa3aec8abfae4d17a3155badc42b4780 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:20.647090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:20.648026 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:20.648535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:20.669416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:20.670649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:20.751510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1237/2445] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:20.759219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:20.759515 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:20.759792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:20.771027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:20.784216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:20.786004 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:20.794469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1209/2446] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:20.799712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:20.818712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd181401-4cb2-4c78-be2d-1823d1aba3bb None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:20.823610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:20.833195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:20.841903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1238/2447] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:24:20.845755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:20.856607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6389a-2717-4f94-9acf-21f5cb0066f3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:20.863221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:20.863221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:20.863221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:20.863221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:20.863611 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:20.865251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:20.958549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1210/2448] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:24:20 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:24:20.959794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:20.970470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae7f5-c2a6-411a-9f97-62b5e489f7d2 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:21.041123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:21.041890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.042242 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.042636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.043400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:21.045495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:21.095764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1239/2449] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:24:20 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:24:21.100453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:21.111906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a598c0-bac5-44bb-bc46-88bb9bea462f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:21.116716 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:21.120139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.120139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.120139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.120139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:21.120575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:21.135794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1211/2450] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:24:21.137124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:21.151946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc325-5432-4b81-8bd3-8f0ded65d07c admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:21.158308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:21.159614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.159999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.160269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.161096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:21.163564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc904a-baa1-4129-8ba2-ae392dc73926 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:21.182019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1240/2451] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:24:21.185705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:21.198285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea62d-329a-4f43-97d3-bfefe4bc0480 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:21.206638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:21.208094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.208726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.209253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] PATH_INFO: `/v3/projects/222c933a308f401982f6ffe2955643e4/users/0dfb3437aac546db9ca5773ecea132a6/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.231592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222c933a308f401982f6ffe2955643e4, user_id=0dfb3437aac546db9ca5773ecea132a6, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:21.235798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:21.352490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1212/2452] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:24:21 2022] PUT /identity/v3/projects/222c933a308f401982f6ffe2955643e4/users/0dfb3437aac546db9ca5773ecea132a6/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:21.358650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca183d-4b9d-4d80-8838-0f151a990c1c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.359144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca183d-4b9d-4d80-8838-0f151a990c1c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.359405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca183d-4b9d-4d80-8838-0f151a990c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.380272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-d9ca183d-4b9d-4d80-8838-0f151a990c1c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:21.382451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d9ca183d-4b9d-4d80-8838-0f151a990c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:21.443463 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:21.454482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1241/2453] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:21.466526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:21.469339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:21.574892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b34575-af83-4864-a251-7a267c9b04f7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:21.587416 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:21.588230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:21.588644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:21.589055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:21.612461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:21.614151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:21.639375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1213/2454] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:23.902788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ae52-b95b-4cd2-822c-f87c63a469cb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:23.903311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ae52-b95b-4cd2-822c-f87c63a469cb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:23.903414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ae52-b95b-4cd2-822c-f87c63a469cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:23.960465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ba68ae52-b95b-4cd2-822c-f87c63a469cb None None] MFA Rules not processed for user `0dfb3437aac546db9ca5773ecea132a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:23.961767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ba68ae52-b95b-4cd2-822c-f87c63a469cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:24.081155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1242/2455] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:24.094062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:24.095836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:24.171433 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680a51-a1d9-40c5-867c-56018bfc0776 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:24.178354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:24.178354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:24.178354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:24.178354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:24.190701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:24.192212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:24.207183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1214/2456] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:26.142553 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6b32-2937-497a-b1c1-6d8f8fc20d14 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:26.143154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6b32-2937-497a-b1c1-6d8f8fc20d14 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:26.143154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6b32-2937-497a-b1c1-6d8f8fc20d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:26.161990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-78ad6b32-2937-497a-b1c1-6d8f8fc20d14 None None] MFA Rules not processed for user `0dfb3437aac546db9ca5773ecea132a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:26.163310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-78ad6b32-2937-497a-b1c1-6d8f8fc20d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:26.171127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1243/2457] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:32.988740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:32.990251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:33.043188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:33.084201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f017-ee4f-4679-bddb-a09f24f62dd5 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:33.090267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:33.091169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:33.091486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:33.091788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:33.093608 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:33.106955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:33.108191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:33.118879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1215/2458] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:36.156614 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=35 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:37.318276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c538-d378-49ac-97e4-a0f11fda3a9e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:37.318928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c538-d378-49ac-97e4-a0f11fda3a9e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:37.318928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c538-d378-49ac-97e4-a0f11fda3a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:37.336590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e581c538-d378-49ac-97e4-a0f11fda3a9e None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:37.337793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e581c538-d378-49ac-97e4-a0f11fda3a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:37.400045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1244/2459] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:24:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:37.413777 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:37.415328 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:37.496094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120e3c-5fc9-412a-bc98-f8e0e86367dc service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:37.502706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:37.503508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:37.503865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:37.504245 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:37.513026 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:37.515330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:37.523962 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1216/2460] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:24:38.101689 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20a0-1eb9-4645-a412-5b3af87b716c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:38.103662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20a0-1eb9-4645-a412-5b3af87b716c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:38.104097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20a0-1eb9-4645-a412-5b3af87b716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:38.124989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-219a20a0-1eb9-4645-a412-5b3af87b716c None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:38.131954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-219a20a0-1eb9-4645-a412-5b3af87b716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:38.172924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1245/2461] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:38.179078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:38.201358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d856bc-2430-4f24-aaba-57561c6ba04a service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:38.222606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:38.223471 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:38.224069 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:38.224206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:38.239907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:38.241605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:38.269394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1217/2462] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 15:24:38.631986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:38.632467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:38.632467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:38.651560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:38.652941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:38.666564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1246/2463] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:38.694088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:38.715626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05836-217d-4e12-8375-18cce047eb0b service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:38.722491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:38.723150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:38.723469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:38.723753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:38.732996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:38.734900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735132c-e237-49c5-884b-e27ab6bf11c2 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:38.749517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1218/2464] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:24:39.296584 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:39.299348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:39.318142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9117d5a-f56b-4849-8dcb-5a75f91f92ca None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:39.324039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:39.324934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:39.325221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:39.325502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] PATH_INFO: `/v3/users/478d19cf2d074ca2afec7d31dad45067` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:39.326948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=478d19cf2d074ca2afec7d31dad45067)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:39.328997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:39.503969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:39.504513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:39.505061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:39.562854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:39.564660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:39.575299 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1219/2465] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:24:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:24:39.589389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:39.599597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478d19cf2d074ca2afec7d31dad45067'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:39.612147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62903-1cc8-4dfa-a251-33ae31588a15 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:39.618096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:39.618972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:39.619523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:39.619985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:39.630630 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:39.632479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34fbd6-c974-4cd9-81b6-cd47274629de service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:39.644334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1220/2466] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:24:39.689420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478d19cf2d074ca2afec7d31dad45067'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:39.690300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478d19cf2d074ca2afec7d31dad45067'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:39.700496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478d19cf2d074ca2afec7d31dad45067'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:39.715747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478d19cf2d074ca2afec7d31dad45067'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:39.723021 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1247/2467] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:24:39 2022] DELETE /identity/v3/users/478d19cf2d074ca2afec7d31dad45067 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:39.727363 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff250-9fd8-4447-a706-30a349609e39 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:39.727842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff250-9fd8-4447-a706-30a349609e39 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:39.728312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff250-9fd8-4447-a706-30a349609e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:39.749744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-15bff250-9fd8-4447-a706-30a349609e39 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:39.751343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-15bff250-9fd8-4447-a706-30a349609e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:39.832586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:39.841578 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1221/2468] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:24:39.851728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:39.853637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:39.962081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53179-fdb2-45d8-9e89-3129bb6ce72e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:39.967513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:39.967513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:39.967981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:39.968427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:39.981249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:39.985321 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:39.997964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1248/2469] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:40.371104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:40.371443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:40.371733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:40.390673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:40.391950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:40.449246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1222/2470] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:40.463777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:40.465709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:40.478778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:40.563966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7ebf1-c5b0-45ca-83ed-d1c7635bade3 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:40.569202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:40.569877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:40.570188 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:40.570500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:40.579774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:40.581459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:40.590183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1249/2471] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:24:40.633991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:40.635450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:40.651840 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e359c-fe5d-46e0-8c72-6025341cd65a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:40.658182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:40.659168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:40.659699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:40.660056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] PATH_INFO: `/v3/projects/74f0b74f53e542918731bbc0950878c7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:40.661475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f0b74f53e542918731bbc0950878c7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:40.664033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:40.835986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f0b74f53e542918731bbc0950878c7', 'request_id': 'req-513a924d-1cf4-4e7c-b22c-259135c8337d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:40.846010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f0b74f53e542918731bbc0950878c7', 'request_id': 'req-513a924d-1cf4-4e7c-b22c-259135c8337d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:40.856338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f0b74f53e542918731bbc0950878c7', 'request_id': 'req-513a924d-1cf4-4e7c-b22c-259135c8337d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:40.958271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] The token cache is being invalidate because project 74f0b74f53e542918731bbc0950878c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:24:40.958654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:40.959300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-513a924d-1cf4-4e7c-b22c-259135c8337d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:40.961188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1223/2472] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:24:40 2022] DELETE /identity/v3/projects/74f0b74f53e542918731bbc0950878c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:43.272185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:43.273727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:43.287911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904670-fb91-483c-8ca3-2e9a3b3c579b service swift] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:43.347374 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:43.348272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:43.348556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:43.348848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] PATH_INFO: `/v3/users/b7931ec0b42042e6bd899e0006e3d23e` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:43.350199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7931ec0b42042e6bd899e0006e3d23e)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:43.352219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:43.543723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7931ec0b42042e6bd899e0006e3d23e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:43.637743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7931ec0b42042e6bd899e0006e3d23e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:43.638439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7931ec0b42042e6bd899e0006e3d23e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:43.646362 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7931ec0b42042e6bd899e0006e3d23e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:43.659107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7931ec0b42042e6bd899e0006e3d23e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:43.665500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1250/2473] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:24:43 2022] DELETE /identity/v3/users/b7931ec0b42042e6bd899e0006e3d23e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:43.670905 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:43.671400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:43.671594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:43.690271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:24:43.691610 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:43.752635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1224/2474] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:24:43.762167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:43.764429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:43.784440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:43.823832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a711c3-0005-4b46-8966-3532140f09ed admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:43.828090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:43.828783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:43.829089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:43.829354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:43.839398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:43.840835 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:43.851317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1251/2475] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:24:44.121326 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:44.123415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:44.137197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f5d01-a8b9-40be-aff2-1cb4566ea859 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:44.147783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:44.147783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:44.147783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:44.147783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] PATH_INFO: `/v3/projects/0219d3f2632c43b2984b8b398ad445c6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:44.148548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0219d3f2632c43b2984b8b398ad445c6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:44.148548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:44.174317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:44.269113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0219d3f2632c43b2984b8b398ad445c6', 'request_id': 'req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:44.275773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0219d3f2632c43b2984b8b398ad445c6', 'request_id': 'req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:44.284390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0219d3f2632c43b2984b8b398ad445c6', 'request_id': 'req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:44.369516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] The token cache is being invalidate because project 0219d3f2632c43b2984b8b398ad445c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:24:44.369900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:44.370596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b3ac62e2-0277-4046-bcea-f8a7c18b6c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:24:44.372378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1225/2476] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:24:44 2022] DELETE /identity/v3/projects/0219d3f2632c43b2984b8b398ad445c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:24:53.505347 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:24:53.514709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910f39-d92d-4077-a1b7-23621316efa5 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:24:53.564246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:24:53.564902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:24:53.565183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:24:53.565460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:24:53.567249 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:24:53.637500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:24:53.639560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efcb83-5221-491c-8610-efebcf1e085f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:24:53.649712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1252/2477] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:24:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:24:54.540367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:01.729776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:01.730497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:01.730497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:01.749853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] MFA Rules not processed for user `9845bb45f86e4e6ca2da841bfc0d0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:01.751137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:01.810537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1226/2478] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:25:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:03.645164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=69 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:11.802354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=25 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:12.333761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed776-15dc-41e4-b0bb-61b2c38fc4ed None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:12.334308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed776-15dc-41e4-b0bb-61b2c38fc4ed None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:12.334308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed776-15dc-41e4-b0bb-61b2c38fc4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:12.352307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-af4ed776-15dc-41e4-b0bb-61b2c38fc4ed None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:12.353486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-af4ed776-15dc-41e4-b0bb-61b2c38fc4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:12.410532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1253/2479] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:12.440808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:12.442198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:12.514778 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e7923-3d9a-4b9f-a706-8753620c3645 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:12.520218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:12.520858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:12.521145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:12.521423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:12.530224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:12.531842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:12.541280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1227/2480] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:25:17.739613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dad7-0275-4c7a-8609-0d734d37a719 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:17.740245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dad7-0275-4c7a-8609-0d734d37a719 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:17.740245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73dad7-0275-4c7a-8609-0d734d37a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:17.761184 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ab73dad7-0275-4c7a-8609-0d734d37a719 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:17.763777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ab73dad7-0275-4c7a-8609-0d734d37a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:17.777254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1254/2481] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:17.799156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:17.811902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dacbf-d8fc-40ed-9a8b-90f297c008ed service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:17.817773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:17.818441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:17.818746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:17.819032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:17.828768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:17.830405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:17.840400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1228/2482] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:25:22.177273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dec504-2928-44b0-9492-9252130075a2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:22.177799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dec504-2928-44b0-9492-9252130075a2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:22.177914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dec504-2928-44b0-9492-9252130075a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:22.196108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a6dec504-2928-44b0-9492-9252130075a2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:22.197446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a6dec504-2928-44b0-9492-9252130075a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:22.205924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1255/2483] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:22.257063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:22.269353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46d5c1-99bd-4846-a5a6-15c9730486b8 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:22.274918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:22.277300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:22.277300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:22.277300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:22.284880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:22.286583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:22.296383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1229/2484] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:25:26.135687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6306-0b51-4380-8f90-a61d20e2882c None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:26.136210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6306-0b51-4380-8f90-a61d20e2882c None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:26.136389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6306-0b51-4380-8f90-a61d20e2882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:26.156197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c63c6306-0b51-4380-8f90-a61d20e2882c None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:26.157406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c63c6306-0b51-4380-8f90-a61d20e2882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:26.165233 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1256/2485] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:26.191818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:26.193227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:26.208294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c37c-f454-4aa2-87cb-8bef4b6e6cbd service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:26.213748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:26.214378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:26.214695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:26.214978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:26.223108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:26.224678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:26.234104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1230/2486] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:25:30.352907 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd9eb-c7ff-42d4-9879-05a8fb8135eb None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:30.353400 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd9eb-c7ff-42d4-9879-05a8fb8135eb None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:30.353516 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebd9eb-c7ff-42d4-9879-05a8fb8135eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:30.372843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-41ebd9eb-c7ff-42d4-9879-05a8fb8135eb None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:30.374031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-41ebd9eb-c7ff-42d4-9879-05a8fb8135eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:30.382695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1257/2487] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:30.419844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:30.431139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33fd75-7cc0-4e8c-82d9-66f010219818 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:30.437411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:30.437979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:30.438265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:30.438576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:30.446663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:30.448233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:30.457898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1231/2488] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:25:34.620617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80307f-0528-4325-8155-302122fe4536 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:34.621636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80307f-0528-4325-8155-302122fe4536 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:34.621758 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80307f-0528-4325-8155-302122fe4536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:34.628332 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=40 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:34.640997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-dd80307f-0528-4325-8155-302122fe4536 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:34.642202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dd80307f-0528-4325-8155-302122fe4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:34.650129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1258/2489] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:34.682907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:25:34.694604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c41e-1674-46c4-9ab5-0e8bae898e84 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:25:34.700532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:25:34.701206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:34.701498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:34.701783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:34.710442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:25:34.712060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bfb23-7915-4749-b294-cacc54235a4b service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:25:34.722618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1232/2490] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:25:44.681567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:44.718018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=64 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:45.352766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc7c4-dae0-469d-83e1-58b9dd60ae61 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:45.353062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc7c4-dae0-469d-83e1-58b9dd60ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:45.353340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc7c4-dae0-469d-83e1-58b9dd60ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:45.370939 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-684fc7c4-dae0-469d-83e1-58b9dd60ae61 None None] MFA Rules not processed for user `ba5568c014414787a4e29cb6aec70707`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:45.372190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-684fc7c4-dae0-469d-83e1-58b9dd60ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:45.427759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1259/2491] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:55.346304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:55.347380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:55.347758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:55.372232 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] MFA Rules not processed for user `0dfb3437aac546db9ca5773ecea132a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:55.374127 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:55.420886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=25 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:55.446485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1233/2492] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:25:59.124064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e8c4-1489-47c8-be1f-bb4e4069d3e4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:25:59.124593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e8c4-1489-47c8-be1f-bb4e4069d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:25:59.124709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e8c4-1489-47c8-be1f-bb4e4069d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:25:59.150483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-67f2e8c4-1489-47c8-be1f-bb4e4069d3e4 None None] MFA Rules not processed for user `5391ed1b9b0b4a01bd2bc9351e2bd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:25:59.151696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-67f2e8c4-1489-47c8-be1f-bb4e4069d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:25:59.206418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1260/2493] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:05.435339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=25 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:09.199481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=25 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:18.732253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:18.733761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:18.759518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f076a-0b2f-49bb-8854-a013d2a26935 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:18.764057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:18.765094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:18.765207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:18.765479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:18.767352 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:18.781916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:18.783430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:18.796615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1234/2494] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:19.788517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec14c-5f0c-484b-8569-5b0989c63044 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:19.789079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec14c-5f0c-484b-8569-5b0989c63044 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:19.789079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec14c-5f0c-484b-8569-5b0989c63044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:19.808217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-cc2ec14c-5f0c-484b-8569-5b0989c63044 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:19.810016 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-cc2ec14c-5f0c-484b-8569-5b0989c63044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:19.817912 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1261/2495] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:19.842239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:19.853568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68798-eb44-45fc-991d-4ecd4c7e7f48 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:19.860430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:19.861110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:19.861395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:19.861674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:19.870942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:19.873181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3e93-7d23-4570-ad74-cb263e40ad01 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:19.882969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1235/2496] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:23.270010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:23.270512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:23.270613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:23.288935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] MFA Rules not processed for user `9845bb45f86e4e6ca2da841bfc0d0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:23.290157 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:23.297743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1262/2497] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:23.443240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:23.443792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:23.443792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:23.462374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:23.463710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:23.472752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1236/2498] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:23.495308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:23.508620 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9c36-d81d-4e14-b027-8cfeb70d4380 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:23.515050 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:23.515707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:23.516002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:23.516289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:23.525055 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:23.526687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:23.537635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1263/2499] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:23.980111 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:23.982233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:23.986281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:23.991778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:24.005443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917e91-537d-476c-894e-91f0f9767e3d service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:24.009427 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:24.010466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:24.010591 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:24.010949 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:24.013541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:24.028129 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:24.029597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927cb88-0e38-436d-99ec-f27061dbca70 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:24.040728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1264/2500] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:26:24.059787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db37404-7fa9-4b98-bcf7-df30930697a0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:24.066321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:24.067136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:24.067422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:24.067698 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:24.069643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:24.091629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:24.093261 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:24.103271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1237/2501] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:26:26.177093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658d12-6c56-4836-ae7e-f83e4dd53ab1 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:26.177676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658d12-6c56-4836-ae7e-f83e4dd53ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:26.177676 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658d12-6c56-4836-ae7e-f83e4dd53ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:26.198042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-49658d12-6c56-4836-ae7e-f83e4dd53ab1 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:26.199359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-49658d12-6c56-4836-ae7e-f83e4dd53ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:26.208682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1265/2502] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:26.242794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:26.256986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89143-6716-4755-93ca-9f1241db6735 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:26.264227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:26.264891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:26.265228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:26.265550 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:26.274705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:26.276305 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:26.295557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1238/2503] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:30.470273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:30.470936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:30.471087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:30.490454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:30.491792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:30.500199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1266/2504] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:30.521880 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:30.534187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037dba-623b-4850-92d5-4fdd4d290095 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:30.539887 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:30.540520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:30.540800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:30.541073 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:30.550312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:30.551913 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5da83f-d9ba-4ace-8fa8-6d427eac6068 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:30.561616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1239/2505] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:33.193477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:33.206506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a64ca3-1462-4144-b760-0cc86274a3a7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:33.212012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:33.212650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:33.212947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:33.213229 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:33.215028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:33.225618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:33.227231 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:33.236767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1267/2506] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:34.706295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:34.706809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:34.706931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:34.725622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:26:34.726858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:34.734728 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1240/2507] 10.222.0.77 () {58 vars in 1016 bytes} [Fri May 27 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:26:34.761118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:34.772562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf9627-318c-4489-9543-11eb79253d8f service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:34.777924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:34.778640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:34.778929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:34.779205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:34.787881 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:34.789958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:34.799303 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1268/2508] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:36.732596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:36.742060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957d29-31d3-433e-942e-c3170f30da50 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:36.745747 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:36.746452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:36.746779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:36.747031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:36.749029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:36.759719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:36.761169 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:36.770711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1241/2509] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:26:44.794708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=36 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:46.520241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:46.521738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:46.583305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c45a-c688-47cb-b59a-ddbabba4c092 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:46.587288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:46.595826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:46.595826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:46.595826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:46.595826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:46.603367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:46.604808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:46.623335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1269/2510] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:46.765742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=68 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:46.782823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:46.796517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef461c-2d2a-49a9-86d4-49f8565cfc96 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:46.803640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:46.804635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:46.804987 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:46.805334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:46.807273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:46.820210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:46.821803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:46.832925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1242/2511] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:26:47.310200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:26:47.323270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e8b1-21cb-4392-9ac8-d8f1546f1894 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:26:47.328948 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:26:47.329678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:26:47.329967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:26:47.330252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:26:47.332111 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:26:47.342525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:26:47.344097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:26:47.353775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1270/2512] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:26:56.856684 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:57.349581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=32 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:09.458948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:09.471448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba7d9-ce15-40f5-b5f1-b5cfa437d530 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:09.476763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:09.479241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:09.479241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:09.479241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:09.480468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:09.492934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:09.494553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:09.506003 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1243/2513] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:09.623415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:09.624859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:09.647908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350953-8bf5-4b30-94d4-49a8bfa3e3e5 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:09.652444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:09.653327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:09.653613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:09.653893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] PATH_INFO: `/v3/users/0dfb3437aac546db9ca5773ecea132a6` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:09.655190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfb3437aac546db9ca5773ecea132a6)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:09.657153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:09.873683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfb3437aac546db9ca5773ecea132a6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:09.914237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:09.924364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed48b07-6d74-4d51-bd62-5d8409f3aab6 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:09.929857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:09.930553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:09.930839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:09.931117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:09.932929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:09.945330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:09.946815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:09.947613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfb3437aac546db9ca5773ecea132a6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:09.948328 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfb3437aac546db9ca5773ecea132a6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:09.957582 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1244/2514] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:27:09.957823 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfb3437aac546db9ca5773ecea132a6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:09.974262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a46f0adc-ee5b-4c62-b76d-8c1be2cb0b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfb3437aac546db9ca5773ecea132a6'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:09.984316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1271/2515] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:27:09 2022] DELETE /identity/v3/users/0dfb3437aac546db9ca5773ecea132a6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:10.252395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:10.264565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380547f3-65a5-47d0-8c6b-e022da7791c6 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:10.359577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:10.360461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:10.360993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:10.361273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] PATH_INFO: `/v3/projects/222c933a308f401982f6ffe2955643e4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:10.362518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=222c933a308f401982f6ffe2955643e4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:10.365875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:10.476935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222c933a308f401982f6ffe2955643e4', 'request_id': 'req-8e439609-efdd-44e6-984f-0f304ddacd5b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:10.482908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222c933a308f401982f6ffe2955643e4', 'request_id': 'req-8e439609-efdd-44e6-984f-0f304ddacd5b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:10.490339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222c933a308f401982f6ffe2955643e4', 'request_id': 'req-8e439609-efdd-44e6-984f-0f304ddacd5b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:10.610250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] The token cache is being invalidate because project 222c933a308f401982f6ffe2955643e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:27:10.610774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:10.611656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e439609-efdd-44e6-984f-0f304ddacd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:10.614475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1245/2516] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:27:10 2022] DELETE /identity/v3/projects/222c933a308f401982f6ffe2955643e4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:10.621659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:10.621955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:10.622269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:10.640106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:10.641322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:10.702486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1272/2517] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:10.763997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:10.764545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:10.764891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:10.784556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:10.786799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:10.794883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1246/2518] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:10.798964 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:10.810270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55265748-dfc9-4068-a5b0-3b421fd86f82 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:10.815049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:10.815715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:10.815999 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:10.816305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:10.817166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:27:10.817483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:10.819186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:10.833518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1273/2519] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:27:10.838037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:10.848385 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2780bc-a8b0-4727-9d09-8ccc0327adf7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:10.853355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:10.854021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:10.854303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:10.854606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:10.855307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:10.857366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:10.956500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1247/2520] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:27:10 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:10.958611 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:10.968438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c2e-5e0f-4ee2-b1f4-c66d595d1427 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:11.027313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:11.028059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.028356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.028644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.029340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:11.031300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:11.038828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:11.183058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1274/2521] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:27:10 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:11.187140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:11.199322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cf9e9-bc29-4260-b7cb-c8cd3308537d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:11.210387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:11.211136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.211581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.211866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.212673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:11.214308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:11.225843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1248/2522] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:11.230205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:11.240322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59b6ea-d883-484e-869c-54f9930b492e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:11.244872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:11.245525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.245806 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.246082 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.246833 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:11.248422 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265052-a6f3-4c05-bf48-2077bfd5b9a5 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:11.260490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1275/2523] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:11.264529 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:11.276138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c40a-4913-4d4f-aea4-0b422848e40b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:11.281034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:11.281923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.282204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.282510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] PATH_INFO: `/v3/projects/16a1b60be7a64c169e1ccfb46aaa0ddc/users/31f39c3fd1a04f828ac8561a38c435fa/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.299123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a1b60be7a64c169e1ccfb46aaa0ddc, user_id=31f39c3fd1a04f828ac8561a38c435fa, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:11.302194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:11.372157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:11.377640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1249/2524] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:27:11 2022] PUT /identity/v3/projects/16a1b60be7a64c169e1ccfb46aaa0ddc/users/31f39c3fd1a04f828ac8561a38c435fa/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:11.383120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161f2e-7331-45ca-9e2f-ba520382844e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.383412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161f2e-7331-45ca-9e2f-ba520382844e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.383690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161f2e-7331-45ca-9e2f-ba520382844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.404214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-dc161f2e-7331-45ca-9e2f-ba520382844e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:11.407165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-dc161f2e-7331-45ca-9e2f-ba520382844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:11.491663 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1276/2525] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:11.502181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:11.505563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:11.593469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f1f7-48c9-4993-be1d-8edf71c8a51c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:11.599056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:11.599776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.600189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.601533 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.623963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:11.625183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:11.640358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1250/2526] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:11.731169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:11.732830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:11.735334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:11.753117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:11.754531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:11.829646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1277/2527] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:11.993568 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:11.995067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:12.127224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba33fe-d4e9-4a53-b5bf-d11c58096433 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:12.134953 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:12.135803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:12.137330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:12.137714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:12.150434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:12.153194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:12.158483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:12.161532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:12.165055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1251/2528] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:27:12.299555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d2faf-61ea-4300-b719-5a17ff313e62 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:12.307801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:12.308479 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:12.308768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:12.309049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:12.313338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:12.328398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:12.331200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:12.344046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1278/2529] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:27:15.251653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:15.253246 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:15.274752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e9d3-6ca2-4167-9a66-34487e2c5da8 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:15.280289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:15.281200 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:15.281591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:15.281941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] PATH_INFO: `/v3/users/5391ed1b9b0b4a01bd2bc9351e2bd4e4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:15.283344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5391ed1b9b0b4a01bd2bc9351e2bd4e4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:15.285461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:15.576372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5391ed1b9b0b4a01bd2bc9351e2bd4e4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:15.577575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5391ed1b9b0b4a01bd2bc9351e2bd4e4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:15.662566 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5391ed1b9b0b4a01bd2bc9351e2bd4e4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:15.663285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5391ed1b9b0b4a01bd2bc9351e2bd4e4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:15.699064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-de95dd6e-7ab6-435a-9107-b3d99bb149f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5391ed1b9b0b4a01bd2bc9351e2bd4e4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:15.721931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1252/2530] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:27:15 2022] DELETE /identity/v3/users/5391ed1b9b0b4a01bd2bc9351e2bd4e4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:16.132863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:16.145352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a84690-f95c-45c1-9bc0-d846726001c0 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:16.151067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:16.262752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:16.263653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:16.263943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:16.264227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] PATH_INFO: `/v3/projects/479e5ffebb7e41ca99bb2752d13b2242` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:16.265571 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479e5ffebb7e41ca99bb2752d13b2242)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:16.267588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:16.423045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479e5ffebb7e41ca99bb2752d13b2242', 'request_id': 'req-0e15191d-84a6-4513-9992-65a8ac135525'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:16.501796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479e5ffebb7e41ca99bb2752d13b2242', 'request_id': 'req-0e15191d-84a6-4513-9992-65a8ac135525'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:16.509751 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479e5ffebb7e41ca99bb2752d13b2242', 'request_id': 'req-0e15191d-84a6-4513-9992-65a8ac135525'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:16.526320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] The token cache is being invalidate because project 479e5ffebb7e41ca99bb2752d13b2242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:27:16.526320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:16.526320 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-0e15191d-84a6-4513-9992-65a8ac135525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:16.534388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:16.535025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:16.535250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:16.536718 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1279/2531] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:27:16 2022] DELETE /identity/v3/projects/479e5ffebb7e41ca99bb2752d13b2242 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:16.543900 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:16.560407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:16.561649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:16.750323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1253/2532] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:16.757025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:16.757465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:16.757929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:16.797955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:16.799865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:16.823070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1280/2533] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:27:16.826951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:16.857819 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a9b6-27d9-4f97-b7a9-a3929688b82f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:16.870259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:16.871112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:16.871881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:16.872178 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:16.873800 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:27:16.873931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:16.875854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:16.890144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1254/2534] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:27:16.895467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:16.920579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294c16-2749-4149-9cbe-0e68c1b43229 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:16.931649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:16.933968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:16.934265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:16.934580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:16.935301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:16.937542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:17.265838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1281/2535] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:17.270251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:17.287466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbfb7-85b9-466c-8492-90a9960c8d07 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:17.383785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:17.385074 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:17.385368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:17.385651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:17.386961 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:17.389711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:17.516347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1255/2536] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:27:17 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:17.521600 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:17.532734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe155a-0708-4eba-b928-4b92d5a0f721 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:17.538195 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:17.539015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:17.539360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:17.539705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:17.540502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:17.542198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:17.559141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1282/2537] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:17.562902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:17.577891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d765633-56e2-405c-9660-ff280de2d490 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:17.589112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:17.590093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:17.590574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:17.591010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:17.591922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:17.594389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509050c2-23ff-4703-92c8-21d7c55ee644 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:17.611179 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:17.611852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1256/2538] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:17.626906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540292c7-d9f6-4368-9323-125becddc112 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:17.633859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:17.635031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:17.635486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:17.635916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] PATH_INFO: `/v3/projects/39646db2ae594465b03c2f14606deb44/users/3e354fe8038f435aa99d20bb653612ef/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:17.656889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39646db2ae594465b03c2f14606deb44, user_id=3e354fe8038f435aa99d20bb653612ef, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:17.660662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:17.725960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1283/2539] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:27:17 2022] PUT /identity/v3/projects/39646db2ae594465b03c2f14606deb44/users/3e354fe8038f435aa99d20bb653612ef/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:17.731278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe48-ae38-4727-a05c-c0fe5754a78d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:17.731739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe48-ae38-4727-a05c-c0fe5754a78d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:17.732205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe48-ae38-4727-a05c-c0fe5754a78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:17.755175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6b2abe48-ae38-4727-a05c-c0fe5754a78d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:17.755593 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6b2abe48-ae38-4727-a05c-c0fe5754a78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:17.857875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1257/2540] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:17.859062 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:17.861146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:17.944715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:18.032077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff00a-6c44-4d36-93bf-dcc8513aa73e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:18.043261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:18.043979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:18.044268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:18.044545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:18.058583 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:18.060045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:18.072687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1284/2541] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:20.952086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:20.952600 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:20.958134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:21.001642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:21.028676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] MFA Rules not processed for user `31f39c3fd1a04f828ac8561a38c435fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:21.028676 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:21.202941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1258/2542] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:21.203727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:21.205707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:21.230491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647477-29ec-4dfd-8a6a-a8da51ae772f service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:21.244711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:21.246123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:21.246438 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:21.253952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:21.253952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:21.256235 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:21.410092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1285/2543] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:27:21 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:27:21.413635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:21.434773 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31d9d7-67a3-46da-9dbd-d8dcc5cb34b1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:21.589667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:21.590445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:21.590759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:21.591095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:21.591966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:21.594018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:21.726190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1259/2544] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:27:21 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:21.731114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:21.748782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f7f5f-b94f-469c-b648-0f34dd543a60 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:21.765077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:21.766073 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:21.766856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:21.767725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:21.771156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:21.775018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:21.799686 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1286/2545] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:21.804539 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:21.818583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8458-7bac-4412-a2c0-8c7ff6748884 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:21.828464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:21.830079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:21.830552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:21.830994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] PATH_INFO: `/v3/projects/099579b9d9c54976b30c1362d6f7401d/users/6e62aba289094a4f925595b6028d5e35/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:21.871481 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099579b9d9c54976b30c1362d6f7401d, user_id=6e62aba289094a4f925595b6028d5e35, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:21.875940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:21.992722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1260/2546] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:27:21 2022] PUT /identity/v3/projects/099579b9d9c54976b30c1362d6f7401d/users/6e62aba289094a4f925595b6028d5e35/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:27:21.997864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:22.014130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183a00e-2b3f-424e-b142-315e71dc6665 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:22.131152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:22.132045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:22.132548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:22.133012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:22.134477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:22.136034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ae856-bdd5-4b0a-b21f-a704f2165c16 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:22.154033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:22.155335 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1287/2547] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:27:22.177632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deba5d-855f-4ab9-839a-93e23cfa8493 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:22.188150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:22.189751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:22.207930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:22.207930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] PATH_INFO: `/v3/projects/099579b9d9c54976b30c1362d6f7401d/users/6e62aba289094a4f925595b6028d5e35/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:22.207930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=099579b9d9c54976b30c1362d6f7401d, user_id=6e62aba289094a4f925595b6028d5e35, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:22.207930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ae8f1-45c2-42cd-a9f1-93f2cb786caf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:22.213167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1261/2548] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:27:22 2022] PUT /identity/v3/projects/099579b9d9c54976b30c1362d6f7401d/users/6e62aba289094a4f925595b6028d5e35/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:27:30.972416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:30.972959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:30.973048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.015984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] MFA Rules not processed for user `3e354fe8038f435aa99d20bb653612ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:31.017349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:31.117209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127245-9317-49db-b72a-ce14b3311c91 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.117686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127245-9317-49db-b72a-ce14b3311c91 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.117790 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127245-9317-49db-b72a-ce14b3311c91 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.119665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1262/2549] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 15:27:31.127418 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.127599 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1288/2550] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:31.128209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.128671 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.151843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:31.153865 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:31.165907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] MFA Rules not processed for user `ec341a30b5274ebc9b12e0bdad2ed8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:31.167427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:31.199173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:31.256276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1263/2551] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:27:31.271798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:31.276487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:31.277172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbce6e6-3ca0-47c2-8d13-0b70e2bc7037 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:31.285390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e9b9-2b83-4cce-a061-39aa3cf6a0d4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:31.292284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:31.293636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.293636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.293636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.294687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:31.295389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.295687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.296570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.315881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:31.318274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481627-e97a-47b5-af02-e36af2bb476b service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:31.321436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:31.323684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40d870-91e8-460e-bd5b-18fcd3894cc6 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:31.333344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1264/2552] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:31.347481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1289/2553] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:27:31.448001 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.450029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.450029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.455640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1265/2554] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:27:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:27:31.465802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d326-7d47-445d-add1-09d34b5cad22 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.466193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d326-7d47-445d-add1-09d34b5cad22 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.466568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d326-7d47-445d-add1-09d34b5cad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.525118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8145d326-7d47-445d-add1-09d34b5cad22 None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:31.526570 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8145d326-7d47-445d-add1-09d34b5cad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:31.560167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1290/2555] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:31.571241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:31.573397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:31.589713 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d65eec-550c-4d56-87b1-4acfb199a266 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:31.593799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:31.594484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:31.594770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:31.595042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:31.607966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:31.609500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:31.626531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1266/2556] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:35.686064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3cb4-f4df-4cdc-82fd-f5c4255c298e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:35.686982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3cb4-f4df-4cdc-82fd-f5c4255c298e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:35.687444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3cb4-f4df-4cdc-82fd-f5c4255c298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:35.724506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-097f3cb4-f4df-4cdc-82fd-f5c4255c298e None None] MFA Rules not processed for user `6e62aba289094a4f925595b6028d5e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:35.726450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-097f3cb4-f4df-4cdc-82fd-f5c4255c298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:35.820786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1291/2557] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:35.834355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:35.835911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:35.926971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350033a3-5535-41a5-8930-4693bdfb596d service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:35.933710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:35.935045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:35.935045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:35.935273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:36.013642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:36.016596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2357-6abf-48f8-a6c6-7329ca21f97a service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:36.034687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1267/2558] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:36.127418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:36.128271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:36.128564 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:36.148492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] MFA Rules not processed for user `3e354fe8038f435aa99d20bb653612ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:36.149792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:36.161166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1292/2559] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:36.289406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:36.289406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:36.289406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:36.310333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:36.311687 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:36.373771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1268/2560] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:36.387895 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:36.393194 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:36.476271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c73f1-e4a7-4cc3-b367-752f32de8808 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:36.481325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:36.481981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:36.482269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:36.482661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:36.492130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:36.493805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:36.504247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1293/2561] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:27:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:27:36.518564 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:36.528263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0d743-7eb6-42fa-b78c-c6a3bf7dec59 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:36.532010 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:36.532656 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:36.532941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:36.533220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:36.535390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:36.545126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:36.546639 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de6fc-57eb-40fc-b0d7-56520aae6e74 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:36.556414 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1269/2562] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:46.196334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:46.210176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d635cd3-9e7e-40a3-82f6-ed0de1f408f7 service swift] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:46.226359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:46.227090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:46.227382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:46.233254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:46.239981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:46.262787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:46.267336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:46.269404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7daf6-e3db-4c3d-b20a-b3ad525e6eb3 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:46.308558 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1294/2563] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:46.552570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:46.684531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad070-432a-4f83-8a40-c700b17592d8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:46.684820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad070-432a-4f83-8a40-c700b17592d8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:46.685101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad070-432a-4f83-8a40-c700b17592d8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:46.686504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1270/2564] 10.222.0.74 () {54 vars in 921 bytes} [Fri May 27 15:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 15:27:46.695087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:46.696193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:46.696582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:46.741982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] MFA Rules not processed for user `4af65d40347141eebeb01eb446f93766`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:46.743735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:46.756884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1295/2565] 10.222.0.74 () {58 vars in 1018 bytes} [Fri May 27 15:27:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:46.770221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dad070-432a-4f83-8a40-c700b17592d8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:46.792655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dad070-432a-4f83-8a40-c700b17592d8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:46.798815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:46.800348 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:46.800636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:46.800914 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:46.817015 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:46.818699 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d638a64-0fc5-453b-b3e7-038db18206eb service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:46.833822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1271/2566] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:27:50.381457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:50.395650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688d72b-1d14-4186-981e-e00ebdb5a10d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:50.401074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:50.402123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:50.402123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:50.410867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:50.410867 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:50.497279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:50.498796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:50.525297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1296/2567] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:27:51.240990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e7b-f458-4f02-b204-69c29bb2ef50 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:51.241544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e7b-f458-4f02-b204-69c29bb2ef50 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:51.241544 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e7b-f458-4f02-b204-69c29bb2ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:51.262793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-11741e7b-f458-4f02-b204-69c29bb2ef50 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:51.264218 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-11741e7b-f458-4f02-b204-69c29bb2ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:51.275703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1272/2568] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:51.296971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:51.312897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0d422-f860-4c99-b596-79114346a596 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:51.319606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:51.320403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:51.320858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:51.321145 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:51.338942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:51.340626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:51.355969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1297/2569] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:27:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:27:52.558801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:52.559867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:52.562517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:52.582993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] MFA Rules not processed for user `31f39c3fd1a04f828ac8561a38c435fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:52.584723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:52.592981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1273/2570] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:56.968710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:56.970234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:56.989045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d5cb-38fb-45da-9842-9e7dafdb367a service swift] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:56.996952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:56.998203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:56.998664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:56.999045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] PATH_INFO: `/v3/users/9845bb45f86e4e6ca2da841bfc0d0c60` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:57.000412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9845bb45f86e4e6ca2da841bfc0d0c60)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:57.003150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:57.913592 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9845bb45f86e4e6ca2da841bfc0d0c60'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:58.294247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9845bb45f86e4e6ca2da841bfc0d0c60'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:58.295652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9845bb45f86e4e6ca2da841bfc0d0c60'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:58.304983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9845bb45f86e4e6ca2da841bfc0d0c60'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:58.318541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-643f2d41-542e-4e2c-a414-a1188a716bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9845bb45f86e4e6ca2da841bfc0d0c60'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:58.327803 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1298/2571] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:27:56 2022] DELETE /identity/v3/users/9845bb45f86e4e6ca2da841bfc0d0c60 => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:58.645489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:58.669028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f886f-ff80-435f-80fc-b295b0699011 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:58.761368 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:58.762347 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:58.762788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:58.763090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] PATH_INFO: `/v3/projects/86e7a17096764d97afa43985cea14bec` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:58.764464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e7a17096764d97afa43985cea14bec)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:58.769109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:59.192999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e7a17096764d97afa43985cea14bec', 'request_id': 'req-e3853fd1-cd66-418c-a371-0cc2f4b95203'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:59.213276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e7a17096764d97afa43985cea14bec', 'request_id': 'req-e3853fd1-cd66-418c-a371-0cc2f4b95203'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:59.227393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e7a17096764d97afa43985cea14bec', 'request_id': 'req-e3853fd1-cd66-418c-a371-0cc2f4b95203'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:59.312683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] The token cache is being invalidate because project 86e7a17096764d97afa43985cea14bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:27:59.313135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:59.313677 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e3853fd1-cd66-418c-a371-0cc2f4b95203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:27:59.316094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1274/2572] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:27:58 2022] DELETE /identity/v3/projects/86e7a17096764d97afa43985cea14bec => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:27:59.321273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:59.321890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:59.322056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:59.358546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:59.359872 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:59.410995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:59.532054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1299/2573] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:59.532422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:59.532422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:59.532422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:59.555504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:27:59.556771 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:27:59.565618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1275/2574] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:27:59.570799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:59.582795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051abb9-1440-4188-9312-0a1504eeeef4 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:59.589447 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:59.590735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:59.591399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:59.592034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:59.593284 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:27:59.593958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:59.598088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:59.618077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1300/2575] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:27:59.619323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:59.629834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb808e7-0ee1-4b3f-8621-a7cf53bfb09f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:59.637210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:59.637906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:59.638195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:59.638521 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:59.639234 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:59.641181 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:27:59.841231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1276/2576] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:27:59 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:27:59.841764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:27:59.854383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb116-57bc-4e70-952e-28bc391b9e6a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:27:59.976984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:27:59.977691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:27:59.977968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:27:59.978255 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:27:59.979003 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:27:59.980946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.076398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1301/2577] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:27:59 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:00.081758 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.092948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e94c2-fcce-4967-aab3-14aa8ae909c5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.103346 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.104453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.104910 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.105372 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.106316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.108064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.125511 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1277/2578] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:28:00.127561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.138071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483185-a6c9-4d45-b4c3-004a263bf255 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.144276 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.145091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.145376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.145661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.146395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.148039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1b5a-daca-4fe9-83d2-c6c7499eb245 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.158903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1302/2579] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:00.162986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.173350 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098b854-3fb1-4269-bca0-c494ad78b015 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.178919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.179821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.180107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.180388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] PATH_INFO: `/v3/projects/bf3552697a4b4a83ad7ad11989cbd7de/users/dd14baa4514c456f9af1677c1fbb9384/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.197732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3552697a4b4a83ad7ad11989cbd7de, user_id=dd14baa4514c456f9af1677c1fbb9384, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.202436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.269343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:00.275000 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1278/2580] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:00 2022] PUT /identity/v3/projects/bf3552697a4b4a83ad7ad11989cbd7de/users/dd14baa4514c456f9af1677c1fbb9384/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:28:00.285068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.285459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.285863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.313473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] MFA Rules not processed for user `dd14baa4514c456f9af1677c1fbb9384`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:00.315440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:00.382603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1303/2581] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:00.387035 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.450921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761a3e-a17b-4a07-bb03-aa0a0eb63b73 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.455674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.456329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.456613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.456885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.457570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.459581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.577300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1279/2582] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:00 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:00.581727 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.592619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f3c2-b4f4-4a64-ba78-de747aa763ad None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.627763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:00.656590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.657181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.657470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.657745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.659118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.661212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.766445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1304/2583] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:00 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:00.769189 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.780044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9fbe2-b353-4598-ab8e-b8b26c85f853 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.786357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.786357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.786357 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.786737 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.787247 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.788839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.800413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1280/2584] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:00.804274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.814443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb657141-6fc6-4e77-ba27-a5fd2b4a72bd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.819395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.820198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.820495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.820784 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.821545 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.823217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d14c3c-ccac-4b35-864c-8f07c0321928 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.833673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1305/2585] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:00.837658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:00.848334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404721de-390d-48fb-a722-abfce480d044 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:00.853048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:00.853929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.854235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.854543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] PATH_INFO: `/v3/projects/1193f2a0ed684eb197d3a4d9ede16903/users/5fd89c6bdfb44ff99184e43e451c8bb2/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:00.869686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1193f2a0ed684eb197d3a4d9ede16903, user_id=5fd89c6bdfb44ff99184e43e451c8bb2, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:00.872393 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:00.969996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1281/2586] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:00 2022] PUT /identity/v3/projects/1193f2a0ed684eb197d3a4d9ede16903/users/5fd89c6bdfb44ff99184e43e451c8bb2/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:00.981058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:00.981403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:00.981691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.009917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] MFA Rules not processed for user `5fd89c6bdfb44ff99184e43e451c8bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:01.011197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:01.076769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1306/2587] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:01.081802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.146358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020d0f-eddc-490d-b8ff-be453b367669 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.151209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.151874 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.152166 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.152450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.153144 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.155129 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.257653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1282/2588] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:01.261732 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.273432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdaeba-cfb7-4683-ae15-dd5249e978d9 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.331135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.331810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.332098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.332376 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.333057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.335010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.421173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1307/2589] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:01 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:01.425497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.437002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f26a1-24a1-42c3-96d9-cb45835835cc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.442876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.443553 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.443856 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.444137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.444949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.446590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.458151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1283/2590] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:01.462015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.472218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368e44-cefd-4a5e-9918-9330fb3509a4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.476858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.477730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.478013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.478288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] PATH_INFO: `/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c/users/00450ff2f46b43cc9d124417ecfb5e35/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.494472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6ad9c6aa694d27a09f45f21d8c004c, user_id=00450ff2f46b43cc9d124417ecfb5e35, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.497103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.588023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1308/2591] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:01 2022] PUT /identity/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c/users/00450ff2f46b43cc9d124417ecfb5e35/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:01.591922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.602007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42b59-fa84-4bfb-b3b1-e0decd6dacc8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.622458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:01.660756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.661690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.662072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.662485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.663579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.665318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ef9a-8041-4807-866b-b0194f770ad4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.675251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1284/2592] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:01.679794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.691017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b34503-5b8e-4820-a7a9-ea9f6005e69d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.695683 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.696624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.696923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.697189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] PATH_INFO: `/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c/users/00450ff2f46b43cc9d124417ecfb5e35/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.699395 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6ad9c6aa694d27a09f45f21d8c004c, user_id=00450ff2f46b43cc9d124417ecfb5e35, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.702027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.708503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:01.713738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1309/2593] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:01 2022] PUT /identity/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c/users/00450ff2f46b43cc9d124417ecfb5e35/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:01.729239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.729535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.729818 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.757959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] MFA Rules not processed for user `00450ff2f46b43cc9d124417ecfb5e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:01.759217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:01.830861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1285/2594] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:01.847590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:01.849589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:01.924356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf8db6-438f-4730-9085-6b3cdee84a02 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:01.928851 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:01.929514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:01.929805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:01.930087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:01.940661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:01.942170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6500e-609c-404a-80ed-2da41e373372 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:01.951897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1310/2595] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:03.001196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:03.003405 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:03.020390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa2ee7-049b-4148-8784-1009444ec972 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:03.026464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:03.026464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:03.026464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:03.026464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:03.098184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:03.100017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:03.110491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1286/2596] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:04.148142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:04.148726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:04.148726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:04.168214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:04.169748 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:04.258010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1311/2597] 10.222.0.74 () {58 vars in 1009 bytes} [Fri May 27 15:28:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:04.271081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:04.272685 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:04.340408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:04.367321 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2919d5-e836-43ba-87d9-18ea249d4600 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:04.372477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:04.375082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:04.375082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:04.375082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:04.385935 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:04.387640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde5ad-e3ab-402a-93cc-beaa74025ed0 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:04.399202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1287/2598] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:28:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:28:09.800539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:09.811826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e09273-f9cd-4347-8d6f-2ee26e0827b3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:09.815928 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:09.816596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:09.816883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:09.817176 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:09.883767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:09.885226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:09.900982 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1312/2599] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:14.488573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=12 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:15.586241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:15.586939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:15.586939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:15.607866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:15.609109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:15.627260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1288/2600] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:15.647260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:15.659669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e99b-c4f1-4a2b-9c50-4f7f6cb38ced service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:15.664885 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:15.667391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:15.667391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:15.667391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:15.675858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:15.677580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8fc9c-0f85-470f-8af6-6e5717671121 service swift] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:15.686137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1313/2601] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:28:15.899364 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:15.964009 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646454d8-5335-4bb4-934c-6835afbe9508 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:15.968847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:15.969739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:15.970021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:15.970295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] PATH_INFO: `/v3/users/dd14baa4514c456f9af1677c1fbb9384` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:15.973567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd14baa4514c456f9af1677c1fbb9384)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:15.975590 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:16.155657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd14baa4514c456f9af1677c1fbb9384'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:16.156311 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd14baa4514c456f9af1677c1fbb9384'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:16.209497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd14baa4514c456f9af1677c1fbb9384'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:16.210435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd14baa4514c456f9af1677c1fbb9384'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:16.228673 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd14baa4514c456f9af1677c1fbb9384'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:16.243991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1289/2602] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:28:15 2022] DELETE /identity/v3/users/dd14baa4514c456f9af1677c1fbb9384 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:16.248445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:16.248843 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:16.249186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:16.269290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:16.270626 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:16.296563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:16.331333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1314/2603] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:16.341427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:16.343863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:16.406583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822244-b5d5-437e-9844-d4ce34842ab0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:16.410869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:16.411526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:16.411813 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:16.412088 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:16.421707 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:16.423197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:16.434860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1290/2604] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:28:16.997882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:16.999368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:17.013797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defb6fa-0034-4e5b-a387-b079d2fa9217 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:17.018839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:17.019713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:17.020034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:17.020313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] PATH_INFO: `/v3/projects/bf3552697a4b4a83ad7ad11989cbd7de` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:17.021505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3552697a4b4a83ad7ad11989cbd7de)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:17.023483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:17.140645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3552697a4b4a83ad7ad11989cbd7de', 'request_id': 'req-f38f39d7-43ce-443e-8919-b36fff648c6d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.218538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3552697a4b4a83ad7ad11989cbd7de', 'request_id': 'req-f38f39d7-43ce-443e-8919-b36fff648c6d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.225189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3552697a4b4a83ad7ad11989cbd7de', 'request_id': 'req-f38f39d7-43ce-443e-8919-b36fff648c6d'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.236154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] The token cache is being invalidate because project bf3552697a4b4a83ad7ad11989cbd7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:28:17.236493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.237573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.239149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1315/2605] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:28:16 2022] DELETE /identity/v3/projects/bf3552697a4b4a83ad7ad11989cbd7de => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:17.243237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:17.253487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1582cd-bdfd-4dc2-b74c-8737bafe7945 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:17.264704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:17.311792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:17.312657 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:17.312940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:17.313214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] PATH_INFO: `/v3/users/5fd89c6bdfb44ff99184e43e451c8bb2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:17.314386 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd89c6bdfb44ff99184e43e451c8bb2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:17.316389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:17.524552 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd89c6bdfb44ff99184e43e451c8bb2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.525099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd89c6bdfb44ff99184e43e451c8bb2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.601284 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd89c6bdfb44ff99184e43e451c8bb2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.601904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd89c6bdfb44ff99184e43e451c8bb2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.614937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd89c6bdfb44ff99184e43e451c8bb2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:17.627007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1291/2606] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:28:17 2022] DELETE /identity/v3/users/5fd89c6bdfb44ff99184e43e451c8bb2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:18.085665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:18.085665 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:18.094286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f39d7-43ce-443e-8919-b36fff648c6d admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:18.170820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:18.178813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:18.178813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:18.178813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] PATH_INFO: `/v3/projects/1193f2a0ed684eb197d3a4d9ede16903` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:18.178813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1193f2a0ed684eb197d3a4d9ede16903)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:18.178813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:18.319780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1193f2a0ed684eb197d3a4d9ede16903', 'request_id': 'req-f0f3e8e6-536c-4d35-8eb9-188192a13611'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.380396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1193f2a0ed684eb197d3a4d9ede16903', 'request_id': 'req-f0f3e8e6-536c-4d35-8eb9-188192a13611'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.382245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:18.387359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1193f2a0ed684eb197d3a4d9ede16903', 'request_id': 'req-f0f3e8e6-536c-4d35-8eb9-188192a13611'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.399969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] The token cache is being invalidate because project 1193f2a0ed684eb197d3a4d9ede16903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:28:18.400264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.400931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.402670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1316/2607] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:28:18 2022] DELETE /identity/v3/projects/1193f2a0ed684eb197d3a4d9ede16903 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:18.406815 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:18.408329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:18.423741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e259d-df2b-4344-bcd3-60ff0cfcc0cd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:18.487785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:18.488659 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:18.488944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:18.489222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] PATH_INFO: `/v3/users/00450ff2f46b43cc9d124417ecfb5e35` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:18.490384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=00450ff2f46b43cc9d124417ecfb5e35)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:18.492448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:18.649161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:18.656928 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00450ff2f46b43cc9d124417ecfb5e35'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.657574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00450ff2f46b43cc9d124417ecfb5e35'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.710549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00450ff2f46b43cc9d124417ecfb5e35'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.711167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00450ff2f46b43cc9d124417ecfb5e35'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.723793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fcdc6475-e37e-49b0-8d2d-ff63dc584bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00450ff2f46b43cc9d124417ecfb5e35'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:18.739034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1292/2608] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:28:18 2022] DELETE /identity/v3/users/00450ff2f46b43cc9d124417ecfb5e35 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:19.262306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:19.264089 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:19.282170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e8e6-536c-4d35-8eb9-188192a13611 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:19.347272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:19.348244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:19.349123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:19.349414 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] PATH_INFO: `/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:19.350642 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6ad9c6aa694d27a09f45f21d8c004c)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:19.352539 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:19.516794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6ad9c6aa694d27a09f45f21d8c004c', 'request_id': 'req-c3764ecb-e07c-4430-98d6-3bccba48ba59'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:19.590047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6ad9c6aa694d27a09f45f21d8c004c', 'request_id': 'req-c3764ecb-e07c-4430-98d6-3bccba48ba59'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:19.595890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6ad9c6aa694d27a09f45f21d8c004c', 'request_id': 'req-c3764ecb-e07c-4430-98d6-3bccba48ba59'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:19.607950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] The token cache is being invalidate because project ce6ad9c6aa694d27a09f45f21d8c004c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:28:19.608246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:19.611672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c3764ecb-e07c-4430-98d6-3bccba48ba59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:19.611672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1317/2609] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:28:19 2022] DELETE /identity/v3/projects/ce6ad9c6aa694d27a09f45f21d8c004c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:19.616272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:19.616776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:19.616876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:19.635565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:19.636755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:19.695603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1293/2610] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:19.704005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:19.704295 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:19.704573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:19.729142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:19.730367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:19.740502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1318/2611] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:19.744883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:19.755583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972e5e0-a0cf-4eff-95c4-e087660e2e82 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:19.760216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:19.760871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:19.761159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:19.761437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:19.762164 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:28:19.762506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:19.764116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:19.779484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1294/2612] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:28:19.783666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:19.792973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8cd02-b94a-4554-ab7d-0cbbc8b4004b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:19.797634 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:19.798341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:19.798661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:19.798942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:19.799631 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:19.801788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:19.931359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1319/2613] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:19 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:19.935601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:19.946183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af0b1-3417-4914-9abe-891330b3ed90 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.003752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.004514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.004811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.005101 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.005795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.007808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.101291 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1295/2614] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:19 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:20.105684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.116154 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595cf1a-9ca0-4125-8252-9d8ecef0c06b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.120746 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.121463 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.121742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.122024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.122783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.124370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.135327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1320/2615] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:20.139271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.150287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31fa4-5bf5-439f-84e1-4a2d524c014b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.154941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.155598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.155881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.156158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.156875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.158491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236265f-7f57-4147-9175-74fb07582ad2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.168879 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1296/2616] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:20.173142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.183856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fcef2-36df-4911-bcd1-5bd8222764b1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.188525 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.192944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.192944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.192944 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] PATH_INFO: `/v3/projects/d1fb79313b47461ea9417b722788a24b/users/40121502ef0b4ee182159d3de454aa57/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.205421 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fb79313b47461ea9417b722788a24b, user_id=40121502ef0b4ee182159d3de454aa57, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.208605 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.324491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1321/2617] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:20 2022] PUT /identity/v3/projects/d1fb79313b47461ea9417b722788a24b/users/40121502ef0b4ee182159d3de454aa57/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:28:20.337122 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.337411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.337696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.373216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] MFA Rules not processed for user `40121502ef0b4ee182159d3de454aa57`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:20.374617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:20.383295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:20.451893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1297/2618] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:20.456933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.470502 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:20.523811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fbeb2-1cba-4b9d-a950-503d6a581e11 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.529640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.530580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.530934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.531275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.532035 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.534095 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.634186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1322/2619] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:20 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:20.638310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.649619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5bce3-1cf1-4197-82ee-f02877fead50 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.709120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.709794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.710195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.710569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.711270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.713210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.808683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1298/2620] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:20 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:28:20.812760 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.824034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482b6e3-f2ec-4d3f-b2b6-c313680b2916 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.829036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.829924 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.830234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.830708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.832470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.834453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.845385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1323/2621] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:28:20.849763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:20.860112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5a66-65b7-4b09-9fbd-f2e82ec40a6b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:20.865817 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:20.873260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:20.873260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:20.873260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] PATH_INFO: `/v3/projects/cec8936de8684142a658e1df74508ebe/users/82b46b20e55d47baafcd6186d38cd0e9/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:20.883628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec8936de8684142a658e1df74508ebe, user_id=82b46b20e55d47baafcd6186d38cd0e9, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:20.886396 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:20.996615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1299/2622] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:20 2022] PUT /identity/v3/projects/cec8936de8684142a658e1df74508ebe/users/82b46b20e55d47baafcd6186d38cd0e9/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:21.000523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:21.011288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd71d-2751-477f-b881-e58b8da917a6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:21.067942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:21.068610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:21.068897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:21.069191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:21.069897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:21.071563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a256ca4-aa7c-4f4f-b78a-eed344f6b932 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:21.081149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1324/2623] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:21.085360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:21.096085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5fa15-bafb-4d96-891c-184bb8227448 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:21.101701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:21.102632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:21.102918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:21.103195 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] PATH_INFO: `/v3/projects/cec8936de8684142a658e1df74508ebe/users/82b46b20e55d47baafcd6186d38cd0e9/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:21.105231 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec8936de8684142a658e1df74508ebe, user_id=82b46b20e55d47baafcd6186d38cd0e9, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:21.107946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:21.118968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1300/2624] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:21 2022] PUT /identity/v3/projects/cec8936de8684142a658e1df74508ebe/users/82b46b20e55d47baafcd6186d38cd0e9/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:21.134886 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:21.135183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:21.135469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:21.162259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] MFA Rules not processed for user `82b46b20e55d47baafcd6186d38cd0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:21.163423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:21.231788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1325/2625] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:21.242965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:21.244795 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:21.301505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41b329-87d0-48d4-b0cd-d99e82dfb2e9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:21.305401 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:21.306036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:21.306334 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:21.315270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:21.316109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:21.317540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:21.326871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1301/2626] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:21.569471 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:21.579079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a1e8-994f-497b-b7e7-dcd73614baf0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:21.583572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:21.584216 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:21.584503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:21.584779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:21.588854 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:21.640213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:21.641640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c85fa-52a5-47cf-aac0-8703befcd4a5 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:21.651259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1326/2627] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:26.696993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:26.702365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:26.762290 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7958-9d7b-4d26-a354-de2db7b300e7 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:26.767322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:26.768194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:26.768466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:26.768745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] PATH_INFO: `/v3/users/40121502ef0b4ee182159d3de454aa57` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:26.770618 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40121502ef0b4ee182159d3de454aa57)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:26.772606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:27.000908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40121502ef0b4ee182159d3de454aa57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.001581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40121502ef0b4ee182159d3de454aa57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.100300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40121502ef0b4ee182159d3de454aa57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.101120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40121502ef0b4ee182159d3de454aa57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.115577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40121502ef0b4ee182159d3de454aa57'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.130240 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1302/2628] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:28:26 2022] DELETE /identity/v3/users/40121502ef0b4ee182159d3de454aa57 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:27.134721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:27.141032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:27.141032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:27.154480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:27.155795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:27.219918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1327/2629] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:27.231117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:27.233378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:27.293577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d230b-22a8-406d-86cf-57fb86885646 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:27.297340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:27.298226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:27.298543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:27.298838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:27.308866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:27.310298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:27.321210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1303/2630] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:27.745772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:27.745772 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:27.757619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b120366-da2b-4732-b2d0-c473d9fad95a None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:27.762586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:27.763499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:27.763783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:27.764054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] PATH_INFO: `/v3/projects/d1fb79313b47461ea9417b722788a24b` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:27.770741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fb79313b47461ea9417b722788a24b)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:27.772687 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:27.888373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fb79313b47461ea9417b722788a24b', 'request_id': 'req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.950253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fb79313b47461ea9417b722788a24b', 'request_id': 'req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.956282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fb79313b47461ea9417b722788a24b', 'request_id': 'req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.967574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] The token cache is being invalidate because project d1fb79313b47461ea9417b722788a24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:28:27.967858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.968481 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:27.970017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1328/2631] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:28:27 2022] DELETE /identity/v3/projects/d1fb79313b47461ea9417b722788a24b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:27.974642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:27.984377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466282c0-5f10-443d-806f-09961cf2f064 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:28.008859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:28.041318 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:28.042123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:28.042427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:28.042712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] PATH_INFO: `/v3/users/82b46b20e55d47baafcd6186d38cd0e9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:28.043898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b46b20e55d47baafcd6186d38cd0e9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:28.045836 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:28.227112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b46b20e55d47baafcd6186d38cd0e9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:28.227770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b46b20e55d47baafcd6186d38cd0e9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:28.305742 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b46b20e55d47baafcd6186d38cd0e9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:28.306316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b46b20e55d47baafcd6186d38cd0e9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:28.319440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be15777e-6c01-4741-843e-35aadaee3803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b46b20e55d47baafcd6186d38cd0e9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:28.334872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1304/2632] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:28:27 2022] DELETE /identity/v3/users/82b46b20e55d47baafcd6186d38cd0e9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:28.757098 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:28.758715 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:28.772653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dc23f-a09f-4481-a56d-a9ca467c36bf admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:28.799655 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:28.830722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:28.831618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:28.831900 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:28.832302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] PATH_INFO: `/v3/projects/cec8936de8684142a658e1df74508ebe` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:28.834152 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec8936de8684142a658e1df74508ebe)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:28.836172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:28.953273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec8936de8684142a658e1df74508ebe', 'request_id': 'req-b96c520b-689f-498b-90ec-fb7242a0a147'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:29.030027 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec8936de8684142a658e1df74508ebe', 'request_id': 'req-b96c520b-689f-498b-90ec-fb7242a0a147'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:29.036077 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec8936de8684142a658e1df74508ebe', 'request_id': 'req-b96c520b-689f-498b-90ec-fb7242a0a147'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:29.048197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] The token cache is being invalidate because project cec8936de8684142a658e1df74508ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:28:29.048486 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:29.049282 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b96c520b-689f-498b-90ec-fb7242a0a147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:28:29.050849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1329/2633] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:28:28 2022] DELETE /identity/v3/projects/cec8936de8684142a658e1df74508ebe => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:29.056270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.056723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.056987 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.075919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:29.077191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:29.138302 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1305/2634] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:29.146064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.151079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.151079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.167399 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:29.168526 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:29.177380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1330/2635] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:29.181933 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.192557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375deb1-e337-4c89-a133-4d4f2121e414 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.197190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.197846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.198130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.198423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.199156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:28:29.199466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.201078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.216745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1306/2636] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:28:29.218520 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.228096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444af2-bc3c-4eee-ac3f-6a21c68a2cf0 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.233134 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.233891 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.234269 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.234691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.245181 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.247441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.345788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1331/2637] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:29.351760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.362342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d2fb-d268-458c-90a3-27e0bcb6aa56 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.394787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:29.421679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.422356 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.422679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.422959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.423721 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.425686 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.513342 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1307/2638] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:29 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:29.514643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.525206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917393cb-b958-4916-ab47-74e9f1954aa4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.529821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.530517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.530802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.531080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.531800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.533373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.545059 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1332/2639] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:29.548948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.553652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.555378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:29.560157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95f78-294e-4a81-99cd-53f28b07ee2d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.564968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.565634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.565942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.566221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.567210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.568824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.582031 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1308/2640] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:29.583076 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.592857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af95f7-fca3-4734-9df2-bbd45b6ac603 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.598702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.599575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.599860 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.600204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] PATH_INFO: `/v3/projects/a56dff4a995644ae8bd5b6bd24578984/users/2615ba7b667743daaf3858b1c053e805/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.616119 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86744-4f01-4ce2-a425-5dbf625435aa admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.616834 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56dff4a995644ae8bd5b6bd24578984, user_id=2615ba7b667743daaf3858b1c053e805, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.619567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f48a35-fa0f-4a57-b6b2-d409fe6062bb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.619792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.620439 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.620721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.620997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.622877 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:29.656054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:29.686261 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.687668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.689142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1309/2641] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:29 2022] PUT /identity/v3/projects/a56dff4a995644ae8bd5b6bd24578984/users/2615ba7b667743daaf3858b1c053e805/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:29.694268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74fca-6fa2-4c39-bcab-e419ff4bcf6e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.694696 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74fca-6fa2-4c39-bcab-e419ff4bcf6e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.695110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74fca-6fa2-4c39-bcab-e419ff4bcf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.706632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1333/2642] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:29.713062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-72d74fca-6fa2-4c39-bcab-e419ff4bcf6e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:29.714310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72d74fca-6fa2-4c39-bcab-e419ff4bcf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:29.779061 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1310/2643] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:28:29.789946 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:29.798805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3e49-3831-4634-af78-46b941ecd12f service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:29.848935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:29.849594 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:29.849880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:29.850159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:29.859492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:29.860926 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:29.871440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1334/2644] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:28:31.337028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d156a-6356-45b2-9846-9609f064a384 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.337535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d156a-6356-45b2-9846-9609f064a384 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.337980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d156a-6356-45b2-9846-9609f064a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.369651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-879d156a-6356-45b2-9846-9609f064a384 None None] MFA Rules not processed for user `2615ba7b667743daaf3858b1c053e805`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:31.370919 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-879d156a-6356-45b2-9846-9609f064a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:31.445689 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1311/2645] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:31.450832 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.465635 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23405-9190-450d-8fea-65b10d97b07b service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.470967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.471658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.471950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.472238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.472975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:31.475207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:31.604006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1335/2646] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:28:31 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:31.608064 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d156a-6356-45b2-9846-9609f064a384 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.620045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d156a-6356-45b2-9846-9609f064a384 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.633665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:31.680250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.681055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.681337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.681613 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.682308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:31.684301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:31.744340 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1312/2647] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:28:31 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:28:31.745658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.756022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240de5-d3c6-41f0-bd57-e07da188ddbd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.760775 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.761437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.761726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.762023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.762779 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:31.764432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:31.776144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1336/2648] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:31.780523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.791545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4808-dff7-4c62-b398-d0d14c9c14ca admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.796108 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.796988 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.797273 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.797548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] PATH_INFO: `/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.814465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdd0a0bdc6a4bc598e741bb6b78f60a, user_id=fd9dbbce7aa8430cb6b0aa37af9c5a7b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:31.817281 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:31.877890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1313/2649] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:31 2022] PUT /identity/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:28:31.882569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.892651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec2-00c4-46a8-aeaa-b8a6ee50876f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.961214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.961802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.962091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.962370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:31.963126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:31.964725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa6e8-86a1-4586-afa0-b430679d398f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:31.975418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1337/2650] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:28:31.979259 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:31.990622 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4492-7a83-4df7-a8e4-1e49226e5317 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:31.996711 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:31.998033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:31.998033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:31.999107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] PATH_INFO: `/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:32.001099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdd0a0bdc6a4bc598e741bb6b78f60a, user_id=fd9dbbce7aa8430cb6b0aa37af9c5a7b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:32.003957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66333213-4d84-42cd-837d-ac573f2e8752 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:32.015631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1314/2651] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:28:31 2022] PUT /identity/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:28:33.699144 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:33.707759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:33.707759 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:33.731797 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] MFA Rules not processed for user `fd9dbbce7aa8430cb6b0aa37af9c5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:33.733061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:33.757846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:33.815894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1338/2652] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:28:33.833731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:33.833731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:33.833731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:33.846159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] MFA Rules not processed for user `2615ba7b667743daaf3858b1c053e805`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:28:33.847335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:33.902762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1315/2653] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:28:33.916681 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:33.918149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:33.994670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281627f-d573-4ad9-b7a8-fe1312a6ce6e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:34.000186 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:34.000830 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:34.001116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:34.001391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:34.009659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:34.011307 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:34.020739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1339/2654] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:28:43.895801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:44.100288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=52 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:50.089049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:28:50.090726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:28:50.153729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b179-c6d1-4b8d-b06e-0ecfe7b782f1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:28:50.157855 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:28:50.158540 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:28:50.158824 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:28:50.159098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:28:50.169397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:28:50.170898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:28:50.181477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1316/2655] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:00.176227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=26 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:07.499334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:07.500756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:07.558816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6a7e-b1f8-43f3-9452-a95bacf2c480 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:07.563017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:07.563812 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:07.564113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:07.565268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:07.570863 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:07.639252 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:07.640696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:07.651556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1340/2656] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:07.948701 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:07.958829 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c00f1-7cce-4050-95d1-661159148ab9 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:07.963884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:07.964563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:07.964850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:07.965130 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:07.966983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:08.038640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:08.040886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:08.055916 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1317/2657] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:10.292404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:10.357322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026429-ee03-4760-a5b1-2d1dd760614c service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:10.380354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:10.381022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:10.381301 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:10.381581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:10.388063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:10.418030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:10.420430 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:10.436038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1341/2658] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:13.300331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:13.301821 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:13.378159 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6b27e-0cf6-4349-8805-e5439c2ac1a1 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:13.383948 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:13.384602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:13.384889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:13.385171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:13.387002 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:13.398802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:13.405006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:13.410442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1318/2659] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:13.471169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:13.473217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:13.489042 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeb2e5-4037-4b1d-98c1-fa1846b0bcc0 service nova] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:13.498384 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:13.499333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:13.499632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:13.500535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] PATH_INFO: `/v3/users/ba5568c014414787a4e29cb6aec70707` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:13.501736 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5568c014414787a4e29cb6aec70707)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:13.503692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:13.754889 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5568c014414787a4e29cb6aec70707'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:13.846061 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5568c014414787a4e29cb6aec70707'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:13.846952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5568c014414787a4e29cb6aec70707'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:13.855773 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5568c014414787a4e29cb6aec70707'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:13.870286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-b714c3b9-6420-4dde-b81f-5b45fe86e4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5568c014414787a4e29cb6aec70707'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:13.877782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1342/2660] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:13 2022] DELETE /identity/v3/users/ba5568c014414787a4e29cb6aec70707 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:14.191162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:14.213859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b20d-8632-42dd-a76c-476f07a20464 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:14.322506 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:14.323458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.323759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.324532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] PATH_INFO: `/v3/projects/cd963558c6d9429189f95901e1c5f37e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.326086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd963558c6d9429189f95901e1c5f37e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:14.328448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:14.510330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:14.524204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd963558c6d9429189f95901e1c5f37e', 'request_id': 'req-cb464cb6-6e58-4815-bb65-1d11d85b58b8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:14.532425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd963558c6d9429189f95901e1c5f37e', 'request_id': 'req-cb464cb6-6e58-4815-bb65-1d11d85b58b8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:14.538118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd963558c6d9429189f95901e1c5f37e', 'request_id': 'req-cb464cb6-6e58-4815-bb65-1d11d85b58b8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:14.626715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] The token cache is being invalidate because project cd963558c6d9429189f95901e1c5f37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:14.627276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:14.628184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cb464cb6-6e58-4815-bb65-1d11d85b58b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:14.630199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1319/2661] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:14 2022] DELETE /identity/v3/projects/cd963558c6d9429189f95901e1c5f37e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:14.637507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.638033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.638033 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.657420 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:14.658719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:14.663039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:14.722239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1343/2662] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:14.731360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.731654 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.731957 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.751160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:14.752307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:14.760954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1320/2663] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:14.765267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:14.775671 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2174db-b6f9-42a9-80aa-6dad59fa89bf None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:14.780729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:14.781245 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.781531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.781837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.782575 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:29:14.784096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:14.784565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:14.797007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1344/2664] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:29:14.801450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:14.812596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43de8e-2a69-459d-aef2-bc24a5f95852 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:14.818503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:14.819400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.819690 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.819965 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.820665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:14.822665 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:14.908786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1321/2665] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:14 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:14.912902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:14.924651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4dddd-c8bc-43cf-bf9a-8a1186e0ae5b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:14.983108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:14.983787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:14.984075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:14.984483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:14.985800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:14.987809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.077238 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1345/2666] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:14 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:15.081530 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.094833 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838db07-0cdf-493c-8d92-3da2a13d0348 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.100344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.101545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.101868 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.102147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.103119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.108717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.117754 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1322/2667] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:15.121641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.131617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82475b3-5799-4c7f-a739-9b005965383e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.136767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.137456 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.137888 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.138162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.138968 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.140598 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.152744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1346/2668] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:15.157217 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.167792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cd741-a324-4358-b41f-8fafab67ed48 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.172599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.173629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.173912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.174183 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] PATH_INFO: `/v3/projects/ae54652b6b1c474b83e64eded5d3cdc3/users/acd336eed6604cd0a1c9416365640eed/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.191302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.193444 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae54652b6b1c474b83e64eded5d3cdc3, user_id=acd336eed6604cd0a1c9416365640eed, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.196800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:15.199227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ee22-a826-4ede-b0a2-3818d81afd35 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.211504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819b58-9fd6-4467-966f-18aef919969b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.216336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.217262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.217538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.217820 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] PATH_INFO: `/v3/users/2615ba7b667743daaf3858b1c053e805` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.219075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2615ba7b667743daaf3858b1c053e805)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.220997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.277390 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1323/2669] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:15 2022] PUT /identity/v3/projects/ae54652b6b1c474b83e64eded5d3cdc3/users/acd336eed6604cd0a1c9416365640eed/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:15.287876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.288165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.288445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.316944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] MFA Rules not processed for user `acd336eed6604cd0a1c9416365640eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:15.318161 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:15.398658 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2615ba7b667743daaf3858b1c053e805'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:15.402269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1324/2670] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:15.412750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.468250 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:15.485872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d97a0c-6f4a-4855-bbeb-bc88c6d47373 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.493095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.494006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.494776 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.495227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.496099 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.498036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.537415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2615ba7b667743daaf3858b1c053e805'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:15.537415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2615ba7b667743daaf3858b1c053e805'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:15.543057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2615ba7b667743daaf3858b1c053e805'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:15.548819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:15.572965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2615ba7b667743daaf3858b1c053e805'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:15.572965 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1347/2671] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:15 2022] DELETE /identity/v3/users/2615ba7b667743daaf3858b1c053e805 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:15.691042 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1325/2672] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:15 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:15.701359 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.703989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:15.777133 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c8d5-b3d3-4d62-b1c2-3057c384364e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.833469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.841448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.842141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.842455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.842738 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.843448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.845531 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.852459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:15.883254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706766f7-475e-4c57-b1c6-8d4cb5bc64f7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:15.883254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:15.883254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:15.883254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:15.884102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] PATH_INFO: `/v3/projects/a56dff4a995644ae8bd5b6bd24578984` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:15.884102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56dff4a995644ae8bd5b6bd24578984)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:15.884102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:15.985521 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1348/2673] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:15 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:15.986489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:15.988120 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.044254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b53c6f-2fda-4f1b-ac0e-4411f8d724f4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.047811 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.048451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.048734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.049007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.050792 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.062953 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.064389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.074593 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1349/2674] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:16.075366 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.084203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9111f4-08e0-438e-9495-abfd5006c78c service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.089135 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.089786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.090067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.090344 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.091109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.092709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.106063 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1350/2675] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:16.110576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.121504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56dff4a995644ae8bd5b6bd24578984', 'request_id': 'req-7716772d-bbe4-4fee-81b5-e984230a0238'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.122286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b27a-7527-4283-979d-8f5c2313bae7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.130315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56dff4a995644ae8bd5b6bd24578984', 'request_id': 'req-7716772d-bbe4-4fee-81b5-e984230a0238'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.137094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56dff4a995644ae8bd5b6bd24578984', 'request_id': 'req-7716772d-bbe4-4fee-81b5-e984230a0238'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.181288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.182286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.182604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.182890 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] PATH_INFO: `/v3/projects/e7404ae2d0794f0d87ef23532257f495/users/5e3e0b5d924e460f9127182af4df3741/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.197709 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7404ae2d0794f0d87ef23532257f495, user_id=5e3e0b5d924e460f9127182af4df3741, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.200392 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.219158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] The token cache is being invalidate because project a56dff4a995644ae8bd5b6bd24578984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:16.219449 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.220138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.221724 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1326/2676] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:15 2022] DELETE /identity/v3/projects/a56dff4a995644ae8bd5b6bd24578984 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:16.225580 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.227733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.236942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:16.241180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716772d-bbe4-4fee-81b5-e984230a0238 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.247341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.248301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.248651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.248993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] PATH_INFO: `/v3/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.250263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9dbbce7aa8430cb6b0aa37af9c5a7b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.252289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.299799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1351/2677] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:16 2022] PUT /identity/v3/projects/e7404ae2d0794f0d87ef23532257f495/users/5e3e0b5d924e460f9127182af4df3741/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:16.304185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.306615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.372666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30665c-1fc1-4974-bec4-d94bc9a4fe2a admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.377289 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.377985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.378641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.379041 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.379922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.382919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.393480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1352/2678] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:16.397355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.407788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515edf-4ce1-4d50-854a-4f834f1b988f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.412323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.413234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.414251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.414512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] PATH_INFO: `/v3/projects/e7404ae2d0794f0d87ef23532257f495/users/5e3e0b5d924e460f9127182af4df3741/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.416356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7404ae2d0794f0d87ef23532257f495, user_id=5e3e0b5d924e460f9127182af4df3741, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.419088 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555c6a2-2f9a-4006-a344-e0df0f4d1677 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.429707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1353/2679] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:16 2022] PUT /identity/v3/projects/e7404ae2d0794f0d87ef23532257f495/users/5e3e0b5d924e460f9127182af4df3741/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:16.439925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.440291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.440690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.469373 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] MFA Rules not processed for user `5e3e0b5d924e460f9127182af4df3741`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:16.470656 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.524411 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9dbbce7aa8430cb6b0aa37af9c5a7b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.525430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9dbbce7aa8430cb6b0aa37af9c5a7b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.545834 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1354/2680] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:16.557172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.558701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.612115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9dbbce7aa8430cb6b0aa37af9c5a7b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.615954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9dbbce7aa8430cb6b0aa37af9c5a7b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.619147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f75d55-5982-45d9-a086-2db81c0c6015 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.625136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.625726 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.626012 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.626285 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.628234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.641884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9dbbce7aa8430cb6b0aa37af9c5a7b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:16.645432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.645432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:16.657028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1355/2681] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:29:16.659237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1327/2682] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:16 2022] DELETE /identity/v3/users/fd9dbbce7aa8430cb6b0aa37af9c5a7b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:16.690286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:16.692072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:16.695847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:16.765998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1c3f-ee6b-429b-ad88-a5ff19bf44bb service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:16.833640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:16.834556 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:16.834844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:16.835122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] PATH_INFO: `/v3/users/acd336eed6604cd0a1c9416365640eed` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:16.837053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd336eed6604cd0a1c9416365640eed)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:16.839057 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.055902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd336eed6604cd0a1c9416365640eed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.072428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.073844 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:17.087798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f970-eb40-4a8d-b2c1-114149f8d3f6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.092631 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.099591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.099591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.099591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] PATH_INFO: `/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.099591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdd0a0bdc6a4bc598e741bb6b78f60a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.099591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.122163 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:17.151352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd336eed6604cd0a1c9416365640eed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.152244 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd336eed6604cd0a1c9416365640eed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.159086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:17.161510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd336eed6604cd0a1c9416365640eed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.184300 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a8ea83ee-d061-46d7-8156-580d9f2565a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd336eed6604cd0a1c9416365640eed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.191361 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1356/2683] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:16 2022] DELETE /identity/v3/users/acd336eed6604cd0a1c9416365640eed => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:17.196191 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.196569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.197005 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.236322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdd0a0bdc6a4bc598e741bb6b78f60a', 'request_id': 'req-80743213-e688-4aad-850b-bdc3c91badda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.244441 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdd0a0bdc6a4bc598e741bb6b78f60a', 'request_id': 'req-80743213-e688-4aad-850b-bdc3c91badda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.247477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:17.248741 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:17.251864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdd0a0bdc6a4bc598e741bb6b78f60a', 'request_id': 'req-80743213-e688-4aad-850b-bdc3c91badda'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.322875 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] The token cache is being invalidate because project 8cdd0a0bdc6a4bc598e741bb6b78f60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:17.323292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.323997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80743213-e688-4aad-850b-bdc3c91badda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:17.325733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1328/2684] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:17 2022] DELETE /identity/v3/projects/8cdd0a0bdc6a4bc598e741bb6b78f60a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:17.330720 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23f07-3943-41d0-baf7-44340baae573 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.331280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23f07-3943-41d0-baf7-44340baae573 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.331624 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23f07-3943-41d0-baf7-44340baae573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.332156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1357/2685] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:17.344075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.345947 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:17.362249 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-77d23f07-3943-41d0-baf7-44340baae573 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:17.365704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-77d23f07-3943-41d0-baf7-44340baae573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:17.378012 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1329/2686] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:17.386682 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.387151 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.387770 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.411383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:17.412846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:17.427118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1330/2687] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:17.436946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.437596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9fe4-98cb-41e0-a4aa-0bfdd304d062 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.442547 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.443205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.443488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.443764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.444482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:29:17.445422 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.447312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.453442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5aacf-90d6-4d3b-af91-ed3b57de117d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.457587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.458246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.458574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.459019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.461731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1331/2688] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:29:17.469903 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.471518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.474714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.484682 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1358/2689] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:17.485793 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1aac9-6499-4fc9-970a-a4cb296dd316 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.493204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.493788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.494072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.494534 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.495230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.500125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.579852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1332/2690] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:17 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:17.581398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.593597 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d4b4-71f1-4ff6-a51f-9c83e2d96dd0 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.658828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.659690 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.660091 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.660372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.661067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.664083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.782868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1359/2691] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:17 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:17.793018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.808072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43cdf-bf01-4842-9805-f8e5b3b699a5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.818949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.818949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.818949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.818949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.819423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.821679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.844096 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.853202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1333/2692] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:17.863566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df370a-2aba-4c5f-ad95-a035313be9dd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.870444 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.871356 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.871694 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.871981 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.872961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.874668 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.877334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:17.887916 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1360/2693] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:17.893243 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.916730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049a88-159e-451b-87e2-f5f0fef3c948 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:17.917882 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:17.918845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:17.919137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:17.919421 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] PATH_INFO: `/v3/projects/bee1f855c4da4ff0960bbcf8d17e63e3/users/3ab9f6b19c83451cbc0a0fe8ab8f2223/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:17.939157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee1f855c4da4ff0960bbcf8d17e63e3, user_id=3ab9f6b19c83451cbc0a0fe8ab8f2223, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:17.943078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c472369-149b-4be5-968e-72d81bca7846 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:17.974724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:17.979014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:18.010979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec49d8a-ff6c-4648-b438-a290359af502 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.017962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.024360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.024360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.024360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] PATH_INFO: `/v3/projects/ae54652b6b1c474b83e64eded5d3cdc3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.024360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae54652b6b1c474b83e64eded5d3cdc3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.024360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.039801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1334/2694] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:17 2022] PUT /identity/v3/projects/bee1f855c4da4ff0960bbcf8d17e63e3/users/3ab9f6b19c83451cbc0a0fe8ab8f2223/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:18.045072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.045518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.045898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.082951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] MFA Rules not processed for user `3ab9f6b19c83451cbc0a0fe8ab8f2223`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:18.084409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:18.166538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1335/2695] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:18.169702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.178700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae54652b6b1c474b83e64eded5d3cdc3', 'request_id': 'req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.187588 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:18.248500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363c46e-7bb7-48bf-9c4f-1bf58b432e1c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.255138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae54652b6b1c474b83e64eded5d3cdc3', 'request_id': 'req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.268416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae54652b6b1c474b83e64eded5d3cdc3', 'request_id': 'req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.308979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] The token cache is being invalidate because project ae54652b6b1c474b83e64eded5d3cdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:18.311713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.313029 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.316483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1361/2696] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:17 2022] DELETE /identity/v3/projects/ae54652b6b1c474b83e64eded5d3cdc3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:18.322210 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.323856 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:18.350545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.362891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.362891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.362891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.362891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.362891 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.398967 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa1a8-9dd1-4631-ab7a-9747036e6da7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.403975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.404876 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.405161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.405445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] PATH_INFO: `/v3/users/5e3e0b5d924e460f9127182af4df3741` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.406868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3e0b5d924e460f9127182af4df3741)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.412882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.458230 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1336/2697] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:18 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:18.463526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.465873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:18.543835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7067fb-75bf-4234-b0d5-301534a50c95 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.550312 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.551005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.551354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.551710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.552473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.555709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.642610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3e0b5d924e460f9127182af4df3741'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.681229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1337/2698] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:18 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:18.682983 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.693223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735446f-538b-4da0-b42e-f4875617fc77 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.698437 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.699157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.699447 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.699722 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.700436 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.702067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.712090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1338/2699] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:18.716190 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.727478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88823-9a0e-4c83-aa0f-74a8cc568595 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.728222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3e0b5d924e460f9127182af4df3741'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.728847 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3e0b5d924e460f9127182af4df3741'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.732376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.738556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.738556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.738556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.738556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.738556 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.739032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3e0b5d924e460f9127182af4df3741'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.747292 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1339/2700] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:18.751504 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:18.754001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-06db6c6c-2b84-4306-895b-ab7698eeff7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3e0b5d924e460f9127182af4df3741'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:18.756197 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:18.761561 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1362/2701] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:18 2022] DELETE /identity/v3/users/5e3e0b5d924e460f9127182af4df3741 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:18.764828 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b563023-85f5-4a89-ac42-3efdc39feb4c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:18.771979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:18.836626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:18.837536 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.837823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.838104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] PATH_INFO: `/v3/projects/c526c76d6b8a48fb87ca52a5cde18ea3/users/d28e8bff97844133a2fffdbe4728e60a/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.860938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c526c76d6b8a48fb87ca52a5cde18ea3, user_id=d28e8bff97844133a2fffdbe4728e60a, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:18.863764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:18.955743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1340/2702] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:18 2022] PUT /identity/v3/projects/c526c76d6b8a48fb87ca52a5cde18ea3/users/d28e8bff97844133a2fffdbe4728e60a/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:18.957541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:18.958009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:18.958108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:18.997221 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] MFA Rules not processed for user `d28e8bff97844133a2fffdbe4728e60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:18.999241 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.093548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1363/2703] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:19.098051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.099970 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.208112 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79251706-6406-4998-87a1-a3efe6dcd62c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.213577 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.214581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.215303 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.215942 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.216845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.219115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.258938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.258938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.283006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d33d-c871-4501-a92d-8fb7d7711294 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.295262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.296390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.296761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.297110 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] PATH_INFO: `/v3/projects/e7404ae2d0794f0d87ef23532257f495` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.298619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7404ae2d0794f0d87ef23532257f495)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.302299 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.309494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1341/2704] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:19.314876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.392485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d8e2a-dde9-4056-aea5-7e0d3e81b89b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.398927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.399997 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.400463 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.400898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.401592 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.403567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.472443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7404ae2d0794f0d87ef23532257f495', 'request_id': 'req-7ed7312a-7d82-419e-a7ba-1990550963ed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:19.543733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1342/2705] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:19.547586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.558548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc7bea-a386-4fb0-bef4-21b9f432e812 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.567070 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:19.568202 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7404ae2d0794f0d87ef23532257f495', 'request_id': 'req-7ed7312a-7d82-419e-a7ba-1990550963ed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:19.578919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7404ae2d0794f0d87ef23532257f495', 'request_id': 'req-7ed7312a-7d82-419e-a7ba-1990550963ed'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:19.598085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] The token cache is being invalidate because project e7404ae2d0794f0d87ef23532257f495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:19.598378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:19.599069 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-7ed7312a-7d82-419e-a7ba-1990550963ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:19.600713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1364/2706] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:19 2022] DELETE /identity/v3/projects/e7404ae2d0794f0d87ef23532257f495 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:19.607537 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58878-ff67-408d-a71f-6a4fdc789d65 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.607897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58878-ff67-408d-a71f-6a4fdc789d65 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.613454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58878-ff67-408d-a71f-6a4fdc789d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.617667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.618317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.618638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.618918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.619733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.621359 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.626723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-afa58878-ff67-408d-a71f-6a4fdc789d65 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:19.627952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-afa58878-ff67-408d-a71f-6a4fdc789d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.635110 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1343/2707] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:19.636128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.638007 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.640149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1365/2708] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:19.648292 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.648972 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.649378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.650986 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089645d8-21d7-49f3-8ae2-56bebbb1b0eb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.656107 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.657653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.657653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.657653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] PATH_INFO: `/v3/projects/9ee800b2cfb848869d2d7427061165fd/users/9edf944605f241dab7b1aae48ab60c67/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.675370 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:19.676731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:19.694134 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee800b2cfb848869d2d7427061165fd, user_id=9edf944605f241dab7b1aae48ab60c67, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.705153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.705369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1366/2709] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:19.705369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.716072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabcd15-a25b-4c13-8ae5-b670cd9314d7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.721023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.721839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.722196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.722667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.723708 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:29:19.724183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.726672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.742485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1367/2710] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:29:19.746932 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.758859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1344/2711] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:19 2022] PUT /identity/v3/projects/9ee800b2cfb848869d2d7427061165fd/users/9edf944605f241dab7b1aae48ab60c67/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:19.770831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.783864 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb3bc6-1c23-4390-a693-dba79c5041e1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.847942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:19.875800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.877083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.877083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.877380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.878151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.878341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae9b-30c4-4511-a4f8-b144d505a52b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.880349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.905559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.906623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.906954 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.907307 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.908141 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.910395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.926512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1345/2712] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:19.928063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:19.938785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4472ff-49a4-4c96-bfd2-d8b87b208a79 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:19.943753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:19.945167 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.949706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.949706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] PATH_INFO: `/v3/projects/9ee800b2cfb848869d2d7427061165fd/users/9edf944605f241dab7b1aae48ab60c67/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:19.949706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee800b2cfb848869d2d7427061165fd, user_id=9edf944605f241dab7b1aae48ab60c67, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:19.950430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d073bf1-89d0-4e22-931e-2074e6787eb7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:19.962632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1346/2713] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:19 2022] PUT /identity/v3/projects/9ee800b2cfb848869d2d7427061165fd/users/9edf944605f241dab7b1aae48ab60c67/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:19.973093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:19.973304 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:19.973586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.010296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] MFA Rules not processed for user `9edf944605f241dab7b1aae48ab60c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:20.011576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:20.014247 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1368/2714] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:20.018466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.076587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:20.082454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb364-681d-446b-951c-3bb9597ea616 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.090104 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.093577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.093958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.100171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.100171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.100171 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.111576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1347/2715] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:20.124315 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.125982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:20.189852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d989b-ad4b-45c7-9c76-a0fc25716dca None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.193668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.194329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.194723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.196194 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.198043 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1369/2716] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:20 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:29:20.198204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:20.201884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.216991 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ff26-2dfa-4f9b-bf1b-20deb9c099ff admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.221508 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.222382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.223080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.223080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.229908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.229908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.237047 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1370/2717] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:20.242402 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.252929 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f03b5-8519-4d4e-b9eb-2889f2bfb5ae admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.259260 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.260228 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.260416 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.260793 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.262013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.263448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.266518 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.266929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd21b6-2702-479c-add6-cb08f98c3c92 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.275753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1371/2718] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:20.276743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1348/2719] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:29:20.279919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.294993 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b48283-4e09-46a1-9ce5-70d576633fa7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.304777 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.306130 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.306560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.306954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] PATH_INFO: `/v3/projects/89580806ac304b61a633c2df9a269187/users/13b630cf2a5740aaa5924db4a1e869cb/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.327001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89580806ac304b61a633c2df9a269187, user_id=13b630cf2a5740aaa5924db4a1e869cb, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.330483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.408763 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1372/2720] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:20 2022] PUT /identity/v3/projects/89580806ac304b61a633c2df9a269187/users/13b630cf2a5740aaa5924db4a1e869cb/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:20.419750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.420041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.420320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.454901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] MFA Rules not processed for user `13b630cf2a5740aaa5924db4a1e869cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:20.456198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:20.528704 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1349/2721] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:20.542557 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:20.544393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:20.618985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ba35-cd6f-42f1-a864-6d6fefb27b8b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:20.623551 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:20.624441 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:20.624800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:20.625485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:20.636467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:20.638080 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:20.656988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1373/2722] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:22.484033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:22.498374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed990319-b2fa-4784-a1fc-8aab25ffbd5f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:22.503049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:22.505498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:22.505498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:22.505498 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:22.506733 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:22.559982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:22.588586 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:22.590599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:22.603358 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1350/2723] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:24.480448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:24.489156 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e93f6-1b70-4e57-8e0b-711e6da1fb30 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:24.494044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:24.494757 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:24.495032 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:24.495306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:24.509563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:24.568995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:24.570994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:24.582612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1374/2724] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:24.797925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:24.799431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:24.876068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e38a-68e9-4efc-a0a7-0861dd8519d4 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:24.880706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:24.881606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:24.882394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:24.882774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] PATH_INFO: `/v3/users/57076420f7ed4d3e88ab61ccd3208d0b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:24.883888 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57076420f7ed4d3e88ab61ccd3208d0b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:24.885801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:25.043667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57076420f7ed4d3e88ab61ccd3208d0b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.044237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57076420f7ed4d3e88ab61ccd3208d0b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.099494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57076420f7ed4d3e88ab61ccd3208d0b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.100132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57076420f7ed4d3e88ab61ccd3208d0b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.112861 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57076420f7ed4d3e88ab61ccd3208d0b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.125254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1351/2725] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:24 2022] DELETE /identity/v3/users/57076420f7ed4d3e88ab61ccd3208d0b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:25.186495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:25.195453 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa435b7-7ef9-4621-b178-db770aa4505d service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:25.265084 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:25.266190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:25.266308 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:25.266548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] PATH_INFO: `/v3/users/13b630cf2a5740aaa5924db4a1e869cb` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:25.267829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b630cf2a5740aaa5924db4a1e869cb)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:25.269814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:25.489514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:25.491931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:25.509260 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dacb5-7fc5-40d9-aa8f-335d429e418b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:25.514063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:25.514976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:25.515268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:25.515548 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] PATH_INFO: `/v3/projects/fde57658f780423881ed97ad8c6a4a76` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:25.520786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde57658f780423881ed97ad8c6a4a76)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:25.520786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:25.558340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b630cf2a5740aaa5924db4a1e869cb'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.620453 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:25.621766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde57658f780423881ed97ad8c6a4a76', 'request_id': 'req-531709e7-b1e4-4b20-8069-7d7953570dc5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.627202 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde57658f780423881ed97ad8c6a4a76', 'request_id': 'req-531709e7-b1e4-4b20-8069-7d7953570dc5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.631142 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b630cf2a5740aaa5924db4a1e869cb'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.631904 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b630cf2a5740aaa5924db4a1e869cb'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.633493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde57658f780423881ed97ad8c6a4a76', 'request_id': 'req-531709e7-b1e4-4b20-8069-7d7953570dc5'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.639846 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b630cf2a5740aaa5924db4a1e869cb'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.651710 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2f9b54fd-2414-40c6-8bda-7d4e3841c917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b630cf2a5740aaa5924db4a1e869cb'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.657753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1375/2726] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:25 2022] DELETE /identity/v3/users/13b630cf2a5740aaa5924db4a1e869cb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:25.661984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:25.664138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:25.664138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:25.681092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:25.682296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:25.706979 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:25.716477 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] The token cache is being invalidate because project fde57658f780423881ed97ad8c6a4a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:25.716772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.717410 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.719279 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1352/2727] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:25 2022] DELETE /identity/v3/projects/fde57658f780423881ed97ad8c6a4a76 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:25.722876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:25.724277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:25.742224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1376/2728] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:25.751827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:25.754582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:25.794495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531709e7-b1e4-4b20-8069-7d7953570dc5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:25.799203 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:25.800252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:25.800545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:25.800823 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] PATH_INFO: `/v3/users/7c0a6a51b0dc4d439c7734fe47b026f6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:25.802174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0a6a51b0dc4d439c7734fe47b026f6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:25.805337 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:25.816495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad3d8-fc12-45b9-acc2-3a4b84bf786e None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:25.820166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:25.820822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:25.821106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:25.821383 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:25.832902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:25.834507 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:25.845403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1377/2729] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:29:25.996738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0a6a51b0dc4d439c7734fe47b026f6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:25.997719 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0a6a51b0dc4d439c7734fe47b026f6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.065079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0a6a51b0dc4d439c7734fe47b026f6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.065750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0a6a51b0dc4d439c7734fe47b026f6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.077996 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0a6a51b0dc4d439c7734fe47b026f6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.090457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1353/2730] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:25 2022] DELETE /identity/v3/users/7c0a6a51b0dc4d439c7734fe47b026f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:26.408262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:26.408262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:26.419670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65390eb-ae33-4655-9440-ea2fdc268ba4 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:26.439196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:26.440670 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:26.501941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:26.503150 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.503495 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.503861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] PATH_INFO: `/v3/projects/89580806ac304b61a633c2df9a269187` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.505243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89580806ac304b61a633c2df9a269187)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:26.508428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:26.535598 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de2828-2246-4315-9564-90a21437ec4c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:26.541456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:26.542322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.542634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.542908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] PATH_INFO: `/v3/projects/212d3b9e0a9f493e818ee534472e0b0f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.544093 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212d3b9e0a9f493e818ee534472e0b0f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:26.546036 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:26.631667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89580806ac304b61a633c2df9a269187', 'request_id': 'req-2a7510c8-f34c-4e26-92e0-3feeb123a948'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.642798 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:26.660797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212d3b9e0a9f493e818ee534472e0b0f', 'request_id': 'req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.666990 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212d3b9e0a9f493e818ee534472e0b0f', 'request_id': 'req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.673220 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212d3b9e0a9f493e818ee534472e0b0f', 'request_id': 'req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.716919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89580806ac304b61a633c2df9a269187', 'request_id': 'req-2a7510c8-f34c-4e26-92e0-3feeb123a948'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.722919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89580806ac304b61a633c2df9a269187', 'request_id': 'req-2a7510c8-f34c-4e26-92e0-3feeb123a948'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.734497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] The token cache is being invalidate because project 89580806ac304b61a633c2df9a269187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:26.734795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.735459 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-2a7510c8-f34c-4e26-92e0-3feeb123a948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.737020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1378/2731] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:26 2022] DELETE /identity/v3/projects/89580806ac304b61a633c2df9a269187 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:26.743100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3b76-a6c9-48bc-bca7-f17f87994fdc None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.743391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3b76-a6c9-48bc-bca7-f17f87994fdc None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.743674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3b76-a6c9-48bc-bca7-f17f87994fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.761296 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-c04c3b76-a6c9-48bc-bca7-f17f87994fdc None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:26.762536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c04c3b76-a6c9-48bc-bca7-f17f87994fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:26.791934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:26.823030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1379/2732] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:26.827890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] The token cache is being invalidate because project 212d3b9e0a9f493e818ee534472e0b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:26.828371 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.828866 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:26.830557 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1354/2733] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:26 2022] DELETE /identity/v3/projects/212d3b9e0a9f493e818ee534472e0b0f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:29:26.831603 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.831945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.832230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.852667 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:26.853908 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:26.862116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1380/2734] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:29:26.866738 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:26.878084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab4d9-c094-41c7-8b19-27c450f3bf56 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:26.883276 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:26.883977 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.884456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.884739 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.885489 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:29:26.885803 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:26.887669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:26.903969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1355/2735] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:29:26.910353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:26.921205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9bf8-2d02-4e71-8415-2c83ad018270 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:26.925973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:26.926701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:26.927056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:26.927348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:26.928203 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:26.930637 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.050102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1381/2736] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:26 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:27.055180 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:27.065982 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4013a-0b32-4163-96b2-7dd8306e2bf1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:27.131046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:27.131734 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.132603 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.132884 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.133574 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:27.135683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.229455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1356/2737] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:27 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:27.233342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:27.243653 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6278a-a5bb-4d75-b522-a3239e74d114 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:27.248259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:27.248914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.249201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.249483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.250309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:27.251813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.265102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1382/2738] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:27.267883 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:27.278274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6cd0-e1bc-4fc1-9c13-7963ed8e8311 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:27.283089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:27.283743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.284027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.284301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.285022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:27.286709 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f020b-ff08-477c-a719-47fc486aefd6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.296801 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1357/2739] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:27.300996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:27.311744 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ad2a0-a34f-4368-a877-a15bc39a6991 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:27.316506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:27.317379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.317662 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.317936 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] PATH_INFO: `/v3/projects/70f8a3f90eb9487b966f5a06c3005f5c/users/0d5cbd3dc4c24952a1927c4d1b62fd6c/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.333170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f8a3f90eb9487b966f5a06c3005f5c, user_id=0d5cbd3dc4c24952a1927c4d1b62fd6c, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:27.337101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.442306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1383/2740] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:27 2022] PUT /identity/v3/projects/70f8a3f90eb9487b966f5a06c3005f5c/users/0d5cbd3dc4c24952a1927c4d1b62fd6c/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:27.454484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.454779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.455063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.481542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] MFA Rules not processed for user `0d5cbd3dc4c24952a1927c4d1b62fd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:27.482812 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:27.524667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:27.550473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1358/2741] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:27.563006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:27.564884 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:27.623752 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ca084-890b-440e-86b3-a95dea636351 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:27.627397 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11e6cdc7569b419fa70ba6524b5a4c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:27.628034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:27.628315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:27.628590 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:27.636790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:27.638204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea71c-0998-4610-a38d-a0c25d82bbf0 service glance] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:27.646800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1384/2742] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:29.470842 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:29.472391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:29.541138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5554d-214a-46b8-83bb-2130edba23ad None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:29.545783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:29.546912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:29.547191 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:29.547462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] PATH_INFO: `/v3/users/3ab9f6b19c83451cbc0a0fe8ab8f2223` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:29.548641 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab9f6b19c83451cbc0a0fe8ab8f2223)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:29.550621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:29.767187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab9f6b19c83451cbc0a0fe8ab8f2223'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:29.767853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab9f6b19c83451cbc0a0fe8ab8f2223'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:29.834761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab9f6b19c83451cbc0a0fe8ab8f2223'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:29.836071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab9f6b19c83451cbc0a0fe8ab8f2223'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:29.848693 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab9f6b19c83451cbc0a0fe8ab8f2223'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:29.862206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1359/2743] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:29 2022] DELETE /identity/v3/users/3ab9f6b19c83451cbc0a0fe8ab8f2223 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:29.867490 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:29.868019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:29.868234 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:29.885887 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:29.887127 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:29.931008 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:29.951388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1385/2744] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:29.961344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:29.962857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:30.027932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb72e7-e166-4b54-a3ab-8552acddd08c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:30.031472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:30.032117 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:30.032399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:30.032674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:30.041759 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:30.043228 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:30.052980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1360/2745] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:30.506919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:30.508445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:30.521076 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59307163-e10c-49da-a1d2-709e71a97f69 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:30.537423 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:30.538919 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:30.539577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:30.539577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] PATH_INFO: `/v3/projects/bee1f855c4da4ff0960bbcf8d17e63e3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:30.540654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee1f855c4da4ff0960bbcf8d17e63e3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:30.542596 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:30.655051 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee1f855c4da4ff0960bbcf8d17e63e3', 'request_id': 'req-303f6675-cc9b-4760-b6fb-e49c7389eac2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.708443 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee1f855c4da4ff0960bbcf8d17e63e3', 'request_id': 'req-303f6675-cc9b-4760-b6fb-e49c7389eac2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.715355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee1f855c4da4ff0960bbcf8d17e63e3', 'request_id': 'req-303f6675-cc9b-4760-b6fb-e49c7389eac2'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.727691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] The token cache is being invalidate because project bee1f855c4da4ff0960bbcf8d17e63e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:30.728011 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.728693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.730265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1386/2746] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:30 2022] DELETE /identity/v3/projects/bee1f855c4da4ff0960bbcf8d17e63e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:30.734251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:30.739244 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:30.744811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2ba7-1acc-4866-8d6d-854ad5d4d42d service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:30.802820 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:30.804095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:30.804367 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:30.804652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] PATH_INFO: `/v3/users/d28e8bff97844133a2fffdbe4728e60a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:30.805850 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28e8bff97844133a2fffdbe4728e60a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:30.807857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:30.979394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28e8bff97844133a2fffdbe4728e60a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:30.980043 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28e8bff97844133a2fffdbe4728e60a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.053653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28e8bff97844133a2fffdbe4728e60a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.054258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28e8bff97844133a2fffdbe4728e60a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.066826 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28e8bff97844133a2fffdbe4728e60a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.080612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1361/2747] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:30 2022] DELETE /identity/v3/users/d28e8bff97844133a2fffdbe4728e60a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:31.544136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:31.546581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:31.579263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6675-cc9b-4760-b6fb-e49c7389eac2 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:31.640925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:31.641810 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:31.642094 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:31.642369 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] PATH_INFO: `/v3/projects/c526c76d6b8a48fb87ca52a5cde18ea3` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:31.643568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c526c76d6b8a48fb87ca52a5cde18ea3)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:31.645717 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:31.768483 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c526c76d6b8a48fb87ca52a5cde18ea3', 'request_id': 'req-3cdbff33-6c9c-4d2e-aba4-82887020acc1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.870713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c526c76d6b8a48fb87ca52a5cde18ea3', 'request_id': 'req-3cdbff33-6c9c-4d2e-aba4-82887020acc1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.876942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c526c76d6b8a48fb87ca52a5cde18ea3', 'request_id': 'req-3cdbff33-6c9c-4d2e-aba4-82887020acc1'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.884281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:31.888855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] The token cache is being invalidate because project c526c76d6b8a48fb87ca52a5cde18ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:31.889396 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.890330 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:31.892821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1387/2748] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:31 2022] DELETE /identity/v3/projects/c526c76d6b8a48fb87ca52a5cde18ea3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:31.897005 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:31.899135 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:31.911959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861f9d-b678-4008-a9c9-72a07f088c8d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:31.972788 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:31.973663 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:31.973946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:31.974219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] PATH_INFO: `/v3/users/9edf944605f241dab7b1aae48ab60c67` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:31.975958 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9edf944605f241dab7b1aae48ab60c67)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:31.978023 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:32.001351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:32.179941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9edf944605f241dab7b1aae48ab60c67'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:32.180605 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9edf944605f241dab7b1aae48ab60c67'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:32.297475 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9edf944605f241dab7b1aae48ab60c67'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:32.298123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9edf944605f241dab7b1aae48ab60c67'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:32.313077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3e64f8c5-f1df-420a-8920-e1e2d1728ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9edf944605f241dab7b1aae48ab60c67'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:32.325794 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1362/2749] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:31 2022] DELETE /identity/v3/users/9edf944605f241dab7b1aae48ab60c67 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:32.816044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:32.817809 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:32.833731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbff33-6c9c-4d2e-aba4-82887020acc1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:32.900138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:32.901106 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:32.901394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:32.901669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] PATH_INFO: `/v3/projects/9ee800b2cfb848869d2d7427061165fd` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:32.903090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee800b2cfb848869d2d7427061165fd)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:32.905046 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.062087 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee800b2cfb848869d2d7427061165fd', 'request_id': 'req-62c7869b-23e1-4555-b057-5c59f623830e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:33.162696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee800b2cfb848869d2d7427061165fd', 'request_id': 'req-62c7869b-23e1-4555-b057-5c59f623830e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:33.170852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee800b2cfb848869d2d7427061165fd', 'request_id': 'req-62c7869b-23e1-4555-b057-5c59f623830e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:33.183178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] The token cache is being invalidate because project 9ee800b2cfb848869d2d7427061165fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:33.183468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:33.184124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-62c7869b-23e1-4555-b057-5c59f623830e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:33.185675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1388/2750] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:32 2022] DELETE /identity/v3/projects/9ee800b2cfb848869d2d7427061165fd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:33.191863 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.192339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.192450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.211589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:33.212927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:33.275607 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1363/2751] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:33.285695 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.285984 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.286271 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.306268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:33.307519 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:33.315425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1389/2752] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:33.319616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.333079 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39674dee-45a2-4986-ada0-26b9de6f3048 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.338732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.339454 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.339736 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.340011 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.340745 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:29:33.341306 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.343165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.356546 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1364/2753] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:29:33.360955 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.372442 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979d760-6721-41cf-9fdd-ef61d1930dc7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.377204 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.377860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.378147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.378450 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.379147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.381070 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.450099 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1390/2754] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:29:33 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:33.454517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.465187 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7384f-bfcb-4b97-af3e-01de1a0578ad admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.525316 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.526019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.526301 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.526634 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.527333 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.529298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.596929 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1365/2755] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:29:33 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:29:33.600941 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.614014 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4e93-ed8e-4349-8e42-7b62d58ccb60 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.620358 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.621038 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.621326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.621606 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.622489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.624025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.638389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1391/2756] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:29:33.639751 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.650854 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b920a-7eeb-4fa0-84eb-8cb689577b5d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.655623 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.656289 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.656573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.656853 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.657561 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.659235 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57f6e5-9432-4b89-9469-01a099953f66 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.670265 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1366/2757] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:29:33.674670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.685898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226beb2c-4081-4169-9d58-db0e4a2a6765 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.690813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.691829 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.692199 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.692451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] PATH_INFO: `/v3/projects/993690969d6f4bfaa98d36aa33d7c487/users/656b81eede3644049251ad06d40b1a68/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.708807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=993690969d6f4bfaa98d36aa33d7c487, user_id=656b81eede3644049251ad06d40b1a68, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.712049 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:33.791262 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1392/2758] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:29:33 2022] PUT /identity/v3/projects/993690969d6f4bfaa98d36aa33d7c487/users/656b81eede3644049251ad06d40b1a68/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:33.801901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.806293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.806293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.815837 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:33.831409 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] MFA Rules not processed for user `656b81eede3644049251ad06d40b1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:33.832668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:33.901674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1367/2759] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:33.914163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:33.916264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:33.946664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:33.977467 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b021-804d-4e2f-965b-fc5b25d01632 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:33.989821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:33.989821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:33.989821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:33.989821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:33.990730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:33.992839 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ac1d9-0ee7-4d20-810d-3d6a28af2e49 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:34.001713 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1393/2760] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:39.853871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:39.918849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b5d09-51dc-4ffc-98cf-867e205a8130 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:39.923615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:39.924493 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:39.924784 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:39.925078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] PATH_INFO: `/v3/users/656b81eede3644049251ad06d40b1a68` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:39.926258 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656b81eede3644049251ad06d40b1a68)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:39.928262 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:40.099388 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656b81eede3644049251ad06d40b1a68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:40.100048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656b81eede3644049251ad06d40b1a68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:40.188216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656b81eede3644049251ad06d40b1a68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:40.188848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656b81eede3644049251ad06d40b1a68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:40.203121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656b81eede3644049251ad06d40b1a68'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:40.215571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1368/2761] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:39 2022] DELETE /identity/v3/users/656b81eede3644049251ad06d40b1a68 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:40.220030 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:40.220511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:40.220627 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:40.237432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:40.238678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:40.296394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1394/2762] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:40.311865 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:40.313257 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:40.332514 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:40.370143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8b6b-aa53-4cf7-b4df-9358eb054ac8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:40.373932 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:40.374616 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:40.374907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:40.375188 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:40.385457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:40.387078 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:40.396839 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1369/2763] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:40.790786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:40.792389 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:40.804791 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d832b-ba76-48bb-92ef-48292d51b04b None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:40.810291 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:40.811177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:40.811470 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:40.811753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] PATH_INFO: `/v3/projects/993690969d6f4bfaa98d36aa33d7c487` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:40.812942 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=993690969d6f4bfaa98d36aa33d7c487)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:40.814906 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:40.926333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993690969d6f4bfaa98d36aa33d7c487', 'request_id': 'req-4837c39e-8e87-4c92-b304-cd260ad7b846'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:41.018723 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993690969d6f4bfaa98d36aa33d7c487', 'request_id': 'req-4837c39e-8e87-4c92-b304-cd260ad7b846'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:41.026151 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993690969d6f4bfaa98d36aa33d7c487', 'request_id': 'req-4837c39e-8e87-4c92-b304-cd260ad7b846'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:41.038327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] The token cache is being invalidate because project 993690969d6f4bfaa98d36aa33d7c487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:41.038587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:41.039239 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-4837c39e-8e87-4c92-b304-cd260ad7b846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:41.042183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1395/2764] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:40 2022] DELETE /identity/v3/projects/993690969d6f4bfaa98d36aa33d7c487 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:50.561980 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=19 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:51.034998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:52.966944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:52.968398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:52.986694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d31a-0961-4fce-a766-f938fbb75d2b service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:53.048331 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:53.049205 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:53.049488 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:53.049763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] PATH_INFO: `/v3/users/0d5cbd3dc4c24952a1927c4d1b62fd6c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:53.050968 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5cbd3dc4c24952a1927c4d1b62fd6c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:53.052898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:53.284791 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5cbd3dc4c24952a1927c4d1b62fd6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:53.285468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5cbd3dc4c24952a1927c4d1b62fd6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:53.371569 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5cbd3dc4c24952a1927c4d1b62fd6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:53.372797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5cbd3dc4c24952a1927c4d1b62fd6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:53.387383 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5cbd3dc4c24952a1927c4d1b62fd6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:53.413113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1370/2765] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:29:52 2022] DELETE /identity/v3/users/0d5cbd3dc4c24952a1927c4d1b62fd6c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:29:53.418147 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:53.418678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:53.418796 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:53.439937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:29:53.441162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:53.507462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1396/2766] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:29:53.517835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:53.519283 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:53.591013 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f7f3-80cb-44ef-a758-df093ff8c289 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:53.594849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:53.595507 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:53.595787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:53.596063 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:53.607140 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:53.608594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:53.622601 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1371/2767] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:29:54.075646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:29:54.077222 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:29:54.090268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444d579-795e-4ef1-b883-0e183a0bd5f2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:29:54.099334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:29:54.100318 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:29:54.100672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:29:54.100956 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] PATH_INFO: `/v3/projects/70f8a3f90eb9487b966f5a06c3005f5c` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:29:54.102253 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f8a3f90eb9487b966f5a06c3005f5c)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:29:54.104970 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:29:54.213643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f8a3f90eb9487b966f5a06c3005f5c', 'request_id': 'req-3f91a25f-3945-4212-a3a0-83a8caf4e37b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:54.280015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f8a3f90eb9487b966f5a06c3005f5c', 'request_id': 'req-3f91a25f-3945-4212-a3a0-83a8caf4e37b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:54.285975 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f8a3f90eb9487b966f5a06c3005f5c', 'request_id': 'req-3f91a25f-3945-4212-a3a0-83a8caf4e37b'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:54.297950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] The token cache is being invalidate because project 70f8a3f90eb9487b966f5a06c3005f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:29:54.298348 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:54.299075 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-3f91a25f-3945-4212-a3a0-83a8caf4e37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:29:54.302652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1397/2768] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:29:54 2022] DELETE /identity/v3/projects/70f8a3f90eb9487b966f5a06c3005f5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:30:03.616987 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:04.294685 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:12.754653 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:12.756082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:12.825799 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f128d0-8d37-448c-8780-f3df9631c95d service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:12.883825 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:12.884469 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:12.884752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:12.885027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:12.886838 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:12.898389 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:12.900090 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:12.910295 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1372/2769] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:30:14.459462 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:14.459952 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:14.460056 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:14.478187 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] MFA Rules not processed for user `580d7a05a3cd412db56c0478b5b3842d`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:30:14.479527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:14.537248 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1398/2770] 10.222.0.74 () {58 vars in 967 bytes} [Fri May 27 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:30:14.678146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:14.679893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:14.748153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5485-452b-4cd3-b6a8-2fb42b6abd1a service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:14.753222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d1b699dac04f23bf3e2f6cd54d33a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:14.753852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:14.754137 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:14.754442 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:14.762430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:14.764029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:14.772045 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1373/2771] 10.222.0.74 () {60 vars in 1384 bytes} [Fri May 27 15:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 15:30:23.062693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:23.064177 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:23.129067 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205f11-d9f7-4cd5-9fbc-32fbdd9cd4a2 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:23.133440 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:23.134306 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:23.134962 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:23.135243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] PATH_INFO: `/v3/users/31f39c3fd1a04f828ac8561a38c435fa` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:23.136434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f39c3fd1a04f828ac8561a38c435fa)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:23.139326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:23.311873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f39c3fd1a04f828ac8561a38c435fa'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.393527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f39c3fd1a04f828ac8561a38c435fa'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.394138 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f39c3fd1a04f828ac8561a38c435fa'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.402015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f39c3fd1a04f828ac8561a38c435fa'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.414700 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f39c3fd1a04f828ac8561a38c435fa'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.421639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1399/2772] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:30:23 2022] DELETE /identity/v3/users/31f39c3fd1a04f828ac8561a38c435fa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:30:23.643059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:23.656310 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d405f-3919-4f01-9574-93dbb9a77c45 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:23.679938 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:23.719384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:23.720282 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:23.720570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:23.720849 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] PATH_INFO: `/v3/projects/16a1b60be7a64c169e1ccfb46aaa0ddc` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:23.722033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a1b60be7a64c169e1ccfb46aaa0ddc)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:23.724052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:23.833443 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a1b60be7a64c169e1ccfb46aaa0ddc', 'request_id': 'req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.838981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a1b60be7a64c169e1ccfb46aaa0ddc', 'request_id': 'req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.845885 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a1b60be7a64c169e1ccfb46aaa0ddc', 'request_id': 'req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.930543 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] The token cache is being invalidate because project 16a1b60be7a64c169e1ccfb46aaa0ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:30:23.930963 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.931584 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:23.933165 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1374/2773] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:30:23 2022] DELETE /identity/v3/projects/16a1b60be7a64c169e1ccfb46aaa0ddc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:30:23.937137 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:23.939569 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:23.952485 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac18-aa0f-4eb5-97a8-467ce637373f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:23.972868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:24.008535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:24.009465 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:24.009754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:24.010045 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] PATH_INFO: `/v3/users/6e62aba289094a4f925595b6028d5e35` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:24.011265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e62aba289094a4f925595b6028d5e35)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:24.020394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:24.209640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e62aba289094a4f925595b6028d5e35'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.267644 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e62aba289094a4f925595b6028d5e35'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.268290 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e62aba289094a4f925595b6028d5e35'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.275693 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e62aba289094a4f925595b6028d5e35'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.288270 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-20f61726-ffd0-4d3a-ac70-e9161ad49dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e62aba289094a4f925595b6028d5e35'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.294497 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1400/2774] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:30:23 2022] DELETE /identity/v3/users/6e62aba289094a4f925595b6028d5e35 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:30:24.522516 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:30:24.523946 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:24.539028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3b09-ee42-465f-8e1f-49bb7bef3da1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:30:24.596027 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:30:24.596920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:24.597207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:24.597485 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] PATH_INFO: `/v3/projects/099579b9d9c54976b30c1362d6f7401d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:24.598695 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] RBAC: Authorizing `identity:delete_project(project_id=099579b9d9c54976b30c1362d6f7401d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:30:24.600606 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:30:24.731491 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099579b9d9c54976b30c1362d6f7401d', 'request_id': 'req-6923e802-c5ab-450b-ba32-5b209903711a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.735435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:24.737934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099579b9d9c54976b30c1362d6f7401d', 'request_id': 'req-6923e802-c5ab-450b-ba32-5b209903711a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.747947 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099579b9d9c54976b30c1362d6f7401d', 'request_id': 'req-6923e802-c5ab-450b-ba32-5b209903711a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.833242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] The token cache is being invalidate because project 099579b9d9c54976b30c1362d6f7401d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:30:24.833451 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.834082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:30:24.835894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1375/2775] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:30:24 2022] DELETE /identity/v3/projects/099579b9d9c54976b30c1362d6f7401d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:30:34.290670 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:34.930479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:46.818801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:30:46.819349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:30:46.819349 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:30:46.839351 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] MFA Rules not processed for user `3e354fe8038f435aa99d20bb653612ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:30:46.840576 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:30:46.900020 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1401/2776] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:30:56.890281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=25 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:37.326017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:31:37.327482 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:31:37.385555 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923e802-c5ab-450b-ba32-5b209903711a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:31:37.389128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:31:37.389765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:31:37.390125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:31:37.390125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:31:37.392120 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:31:37.461872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:31:37.463335 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:31:37.474237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1376/2777] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:31:42.160251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:31:42.169679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eccfe-70a4-47a4-a48e-0f52a32ec0c3 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:31:42.174315 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:31:42.174931 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:31:42.175214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:31:42.175488 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:31:42.177293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:31:42.191240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:31:42.195372 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:31:42.203437 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1402/2778] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:31:47.469288 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=54 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:51.977843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:31:51.980702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:31:52.000370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cdc4f-5feb-405a-af62-bc57ad030f4d service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:31:52.006811 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af65d40347141eebeb01eb446f93766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:31:52.007466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:31:52.007753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:31:52.008242 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:31:52.017524 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:31:52.030847 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:31:52.032508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:31:52.044502 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1377/2779] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:31:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:31:52.198837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=6 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:02.039039 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:02.147707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:02.149286 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:02.213911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7dc40-c697-4ecf-9bec-bb1c6f9ea338 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:02.218390 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:02.219287 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:02.219563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:02.219836 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] PATH_INFO: `/v3/users/3e354fe8038f435aa99d20bb653612ef` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:02.220998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e354fe8038f435aa99d20bb653612ef)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:02.223613 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:02.404848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e354fe8038f435aa99d20bb653612ef'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.471323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e354fe8038f435aa99d20bb653612ef'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.471990 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e354fe8038f435aa99d20bb653612ef'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.478909 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e354fe8038f435aa99d20bb653612ef'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.490503 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-1d51e072-9a5f-4c1f-a2e4-a7b8c537d59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e354fe8038f435aa99d20bb653612ef'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.496319 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1403/2780] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:02 2022] DELETE /identity/v3/users/3e354fe8038f435aa99d20bb653612ef => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:02.767786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:02.780344 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a998-e698-4f6f-b0eb-26108a83f12f service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:02.838714 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:02.839589 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:02.839871 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:02.840145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] PATH_INFO: `/v3/projects/39646db2ae594465b03c2f14606deb44` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:02.841320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39646db2ae594465b03c2f14606deb44)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:02.843254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:02.952440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39646db2ae594465b03c2f14606deb44', 'request_id': 'req-7752340c-336a-45b7-a658-291ae28428d6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.957981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39646db2ae594465b03c2f14606deb44', 'request_id': 'req-7752340c-336a-45b7-a658-291ae28428d6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:02.964154 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39646db2ae594465b03c2f14606deb44', 'request_id': 'req-7752340c-336a-45b7-a658-291ae28428d6'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:03.059612 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] The token cache is being invalidate because project 39646db2ae594465b03c2f14606deb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:03.062300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:03.062300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7752340c-336a-45b7-a658-291ae28428d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:03.062300 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1378/2781] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:02 2022] DELETE /identity/v3/projects/39646db2ae594465b03c2f14606deb44 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:03.067951 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.068268 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.068567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.086764 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:03.091006 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:03.148131 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1404/2782] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:32:03.155851 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.156145 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.156431 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.175950 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:03.177158 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:03.185375 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1379/2783] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:03.189472 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.199579 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e833a-c9c3-4bee-8e75-73662ebdc031 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.204165 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.204814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.205101 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.205382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.206673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:03.206986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.208573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.219871 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1405/2784] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:32:03.224620 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.233717 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ac96-7876-4a83-9b4a-57e320e23501 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.239080 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.239731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.240047 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.240327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.241038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.243019 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.339104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1380/2785] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:03 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:03.343170 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.354017 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa338-3b9e-4256-a76a-80fbfdd13a77 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.357703 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:03.411311 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.411989 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.412279 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.412563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.413267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.415209 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.491582 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1406/2786] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:03 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:03.495351 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.506896 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f02ac-422d-4535-ade8-04682cac5ff5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.511563 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.512229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.512497 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.512772 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.513907 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.515531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.528123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1381/2787] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:32:03.532039 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.543083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1792-6072-41b6-97e1-599aa04be327 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.547565 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.548218 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.548506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.548787 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.549546 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.551650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b810b47-1c91-4c51-803d-8a3eef8e1ad1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.561769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1407/2788] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 15:32:03.565730 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.575679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1164e-f7e5-4bb8-8c78-a53e4bc11784 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.580366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.581783 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.582068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.582374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] PATH_INFO: `/v3/projects/79329b78df754912920c4d9d4e3907a5/users/a5bb5749e3ea45f0acb5c3bdb8546967/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.597609 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79329b78df754912920c4d9d4e3907a5, user_id=a5bb5749e3ea45f0acb5c3bdb8546967, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.600329 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.656921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1382/2789] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:03 2022] PUT /identity/v3/projects/79329b78df754912920c4d9d4e3907a5/users/a5bb5749e3ea45f0acb5c3bdb8546967/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:03.669323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.675121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.675121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.696756 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] MFA Rules not processed for user `a5bb5749e3ea45f0acb5c3bdb8546967`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:03.697958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:03.760874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1408/2790] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:03.772387 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:03.774086 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:03.804455 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:03.829741 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1864-0029-4fa3-8919-4d412958ae9b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:03.834959 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:03.835636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:03.835925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:03.836204 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:03.844683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:03.846119 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425900c-6aea-4294-8ea6-245e1b7be590 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:03.856029 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1383/2791] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:13.374630 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:13.436429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380219d-1adf-4156-a2bc-9f76eca68c92 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:13.440826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:13.441828 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:13.442109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:13.442380 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] PATH_INFO: `/v3/users/a5bb5749e3ea45f0acb5c3bdb8546967` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:13.443649 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bb5749e3ea45f0acb5c3bdb8546967)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:13.445543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:13.461418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:13.619461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bb5749e3ea45f0acb5c3bdb8546967'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:13.736860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bb5749e3ea45f0acb5c3bdb8546967'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:13.738117 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bb5749e3ea45f0acb5c3bdb8546967'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:13.745640 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bb5749e3ea45f0acb5c3bdb8546967'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:13.757504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bb5749e3ea45f0acb5c3bdb8546967'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:13.763461 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1409/2792] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:13 2022] DELETE /identity/v3/users/a5bb5749e3ea45f0acb5c3bdb8546967 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:13.768038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:13.768513 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:13.768621 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:13.786809 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:13.788143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:13.848397 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1384/2793] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:13.858036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:13.859455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:13.916801 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27329-38d0-46a1-8996-5bd517d81196 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:13.920513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:13.921173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:13.921458 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:13.921739 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:13.931550 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:13.932973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3eb73-1447-45c3-b5c6-270c23a4cae5 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:13.943230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1410/2794] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:14.325084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:14.326542 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:14.339571 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0728b-a646-43f2-ad8b-88dfa7ab2a80 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:14.344186 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:14.345089 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.345370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.345645 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] PATH_INFO: `/v3/projects/79329b78df754912920c4d9d4e3907a5` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.346889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79329b78df754912920c4d9d4e3907a5)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:14.349147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:14.446123 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79329b78df754912920c4d9d4e3907a5', 'request_id': 'req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:14.451615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79329b78df754912920c4d9d4e3907a5', 'request_id': 'req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:14.458743 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79329b78df754912920c4d9d4e3907a5', 'request_id': 'req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:14.547109 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] The token cache is being invalidate because project 79329b78df754912920c4d9d4e3907a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:14.547394 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:14.548006 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b0aea8cb-d3fe-4f49-9093-d8ae6b9c3141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:14.549558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1385/2795] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:14 2022] DELETE /identity/v3/projects/79329b78df754912920c4d9d4e3907a5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:14.555316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.555798 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.555915 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.573113 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:14.574298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:14.633735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1411/2796] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:14.641643 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.641930 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.642209 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.661398 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:14.662655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:14.670650 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1386/2797] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:14.674813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:14.685766 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231cd2c-bb09-4bda-a5b0-1bc6b85fa6b5 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:14.690274 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:14.690995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.691293 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.691572 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.692317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:14.692622 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:14.694226 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:14.705505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1412/2798] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:32:14.710059 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:14.719174 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fae33-5dc8-45fa-9fcb-94cbf129b528 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:14.724415 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:14.725060 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.725339 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.725615 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.726296 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:14.728214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:14.807068 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1387/2799] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:14 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:32:14.811166 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:14.822146 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b47b-aa10-4cf5-9df6-a2d9307aa74e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:14.843365 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:14.880517 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:14.881213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.881542 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.881827 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.882563 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:14.884489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:14.968873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1413/2800] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:14 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:14.973065 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:14.983517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8460ee-3601-461a-8b8d-de96c9121b44 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:14.988845 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:14.989508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:14.989797 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:14.990083 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:14.990858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:14.992461 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.002869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1388/2801] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:15.007513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.017586 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6883-a507-4d1d-900a-f68e53cb7856 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.022950 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.023604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.023893 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.024175 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.024898 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.026574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385ce9-c502-4b63-8583-2f076fed775b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.037105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1414/2802] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:15.040978 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.051075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201570-85dd-46c9-b8c0-5c49de469e3c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.056034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.056908 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.057197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.057479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] PATH_INFO: `/v3/projects/8c36d80720434c2cb1d8315bc8cf73fa/users/fa407e2db2404f61a05847e11ba1c417/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.068945 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:15.072765 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c36d80720434c2cb1d8315bc8cf73fa, user_id=fa407e2db2404f61a05847e11ba1c417, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.075465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.136237 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1389/2803] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:15 2022] PUT /identity/v3/projects/8c36d80720434c2cb1d8315bc8cf73fa/users/fa407e2db2404f61a05847e11ba1c417/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:15.147805 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.148102 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.148388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.174340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] MFA Rules not processed for user `fa407e2db2404f61a05847e11ba1c417`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:15.175659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:15.240609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1415/2804] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:15.245049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.306476 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba144a7-4336-41cc-b71e-a96df5874d0d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.311185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.311846 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.312138 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.312423 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.313113 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.315062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.393222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1390/2805] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:15 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:15.396560 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.407367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b232-49df-4030-b6b4-c6b408177170 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.462469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.463132 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.463415 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.463691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.464379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.466273 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.535183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1416/2806] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:15 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:15.539207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.550270 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91426ef6-a7b8-4a9c-8971-e2e977096bfb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.555520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.559559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.559559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.559559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.559559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.559559 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.570263 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1391/2807] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:15.574314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.584973 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19a9b1-cebb-4eef-af88-fd73bd9a47de admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.589728 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.590659 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.591009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.591294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] PATH_INFO: `/v3/projects/a90cf3f98ee046c18a2424c999fb9721/users/80ef109da88c4e1dabfaf5f58e0d56dc/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.606555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90cf3f98ee046c18a2424c999fb9721, user_id=80ef109da88c4e1dabfaf5f58e0d56dc, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.609206 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.657790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:15.664121 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1417/2808] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:15 2022] PUT /identity/v3/projects/a90cf3f98ee046c18a2424c999fb9721/users/80ef109da88c4e1dabfaf5f58e0d56dc/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:32:15.668016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.678604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa75c-6932-4cee-baeb-3ff52eaf54a9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.735184 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.736207 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.736487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.736760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.737494 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.739212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705470b-7987-4151-8086-7e1735885a05 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.748768 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1392/2809] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:15.752880 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.763646 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21171a-dff2-457b-97bc-360f053377a9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.768283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.770116 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.770457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.770742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] PATH_INFO: `/v3/projects/a90cf3f98ee046c18a2424c999fb9721/users/80ef109da88c4e1dabfaf5f58e0d56dc/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.772706 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90cf3f98ee046c18a2424c999fb9721, user_id=80ef109da88c4e1dabfaf5f58e0d56dc, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.775379 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.786625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1418/2810] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:15 2022] PUT /identity/v3/projects/a90cf3f98ee046c18a2424c999fb9721/users/80ef109da88c4e1dabfaf5f58e0d56dc/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:15.797655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.798017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.798323 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.825139 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] MFA Rules not processed for user `80ef109da88c4e1dabfaf5f58e0d56dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:15.826330 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:15.874095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:15.897496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1393/2811] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:15.908680 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:15.911518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:15.968354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40285-44bb-4b62-9622-d2872a1e4ddf admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:15.972457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:15.973304 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:15.973587 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:15.973868 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:15.982585 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:15.983996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:15.993859 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1419/2812] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:16.117413 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:16.118897 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:16.132554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270137-f70f-4e5c-9f65-39b6351dfdef None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:16.136226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:16.136872 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:16.137155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:16.137434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:16.195126 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:16.196572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc586d9-28b7-4b95-ab88-48b328301e6b service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:16.205460 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1394/2813] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:21.102552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:21.164180 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8d28-4342-4b4c-9de5-90bf6883f714 service cinder] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:21.168544 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:21.169405 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:21.169707 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:21.169983 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] PATH_INFO: `/v3/users/fa407e2db2404f61a05847e11ba1c417` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:21.171164 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa407e2db2404f61a05847e11ba1c417)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:21.173053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:21.376168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa407e2db2404f61a05847e11ba1c417'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:21.448431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa407e2db2404f61a05847e11ba1c417'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:21.449193 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa407e2db2404f61a05847e11ba1c417'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:21.456434 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa407e2db2404f61a05847e11ba1c417'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:21.468105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa407e2db2404f61a05847e11ba1c417'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:21.474314 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1420/2814] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:21 2022] DELETE /identity/v3/users/fa407e2db2404f61a05847e11ba1c417 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:21.479206 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:21.479703 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:21.479802 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:21.497509 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:21.498867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:21.558465 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1395/2815] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:21.576124 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:21.577641 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:21.588172 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:21.635240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25697-9cd3-4a14-b0c6-4d7eea0a77db admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:21.638896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:21.644547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:21.644547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:21.644547 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:21.649595 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:21.651054 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:21.661455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1421/2816] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:22.062082 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:22.063587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:22.075752 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a813-1f8b-4c57-b590-37e031377815 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:22.080473 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:22.081832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:22.081832 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:22.082097 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] PATH_INFO: `/v3/projects/8c36d80720434c2cb1d8315bc8cf73fa` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:22.083298 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c36d80720434c2cb1d8315bc8cf73fa)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:22.085216 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:22.197906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c36d80720434c2cb1d8315bc8cf73fa', 'request_id': 'req-2b9055d7-b78f-42a7-a075-4feb1fb17269'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.203683 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c36d80720434c2cb1d8315bc8cf73fa', 'request_id': 'req-2b9055d7-b78f-42a7-a075-4feb1fb17269'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.210974 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c36d80720434c2cb1d8315bc8cf73fa', 'request_id': 'req-2b9055d7-b78f-42a7-a075-4feb1fb17269'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.284121 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] The token cache is being invalidate because project 8c36d80720434c2cb1d8315bc8cf73fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:22.284998 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.285626 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.287225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1396/2817] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:22 2022] DELETE /identity/v3/projects/8c36d80720434c2cb1d8315bc8cf73fa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:22.291109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:22.300870 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf17-31d8-4085-8f90-f6276c1b2840 service neutron] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:22.356842 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:22.357645 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:22.357925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:22.358200 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] PATH_INFO: `/v3/users/80ef109da88c4e1dabfaf5f58e0d56dc` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:22.359388 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ef109da88c4e1dabfaf5f58e0d56dc)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:22.361281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:22.525086 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ef109da88c4e1dabfaf5f58e0d56dc'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.591417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ef109da88c4e1dabfaf5f58e0d56dc'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.592066 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ef109da88c4e1dabfaf5f58e0d56dc'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.599007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ef109da88c4e1dabfaf5f58e0d56dc'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.610733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-dd47851d-fe1f-443c-bc35-197fd9e54bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ef109da88c4e1dabfaf5f58e0d56dc'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:22.616701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1422/2818] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:22 2022] DELETE /identity/v3/users/80ef109da88c4e1dabfaf5f58e0d56dc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:23.034071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.036517 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:23.049969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9055d7-b78f-42a7-a075-4feb1fb17269 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.054044 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:23.109008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.109940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.110221 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.110523 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] PATH_INFO: `/v3/projects/a90cf3f98ee046c18a2424c999fb9721` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.111694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90cf3f98ee046c18a2424c999fb9721)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.114277 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.209160 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90cf3f98ee046c18a2424c999fb9721', 'request_id': 'req-b5e31603-e260-4a51-8efb-d7703fb2202b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:23.214694 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90cf3f98ee046c18a2424c999fb9721', 'request_id': 'req-b5e31603-e260-4a51-8efb-d7703fb2202b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:23.220702 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90cf3f98ee046c18a2424c999fb9721', 'request_id': 'req-b5e31603-e260-4a51-8efb-d7703fb2202b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:23.287951 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] The token cache is being invalidate because project a90cf3f98ee046c18a2424c999fb9721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:23.288239 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:23.288876 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b5e31603-e260-4a51-8efb-d7703fb2202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:23.290490 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1397/2819] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:23 2022] DELETE /identity/v3/projects/a90cf3f98ee046c18a2424c999fb9721 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:23.302325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.302325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.302325 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.314633 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:23.316025 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:23.341445 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:23.376873 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1423/2820] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:23.384681 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.384972 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.385251 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.403625 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:23.404822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:23.413464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1398/2821] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:23.417476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.428109 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5396-1579-4a8a-8858-56cfabc80273 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.433555 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.434207 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.434523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.434825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.435568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:23.435874 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.437460 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.449535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1424/2822] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:32:23.453906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.463973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df27a-e33f-4967-ad7c-34e403a6601e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.468638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.469287 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.469575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.469858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.470576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.472532 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.543565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1399/2823] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:23 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:23.547473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.558297 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9811522-14d2-41f0-a18b-bf67dcba99bd admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.614378 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.614802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.615092 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.615375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.616090 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.617996 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.708543 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1425/2824] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:23 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:23.712487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.723056 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575b838-f22e-499b-84ad-01200a6b77cf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.727969 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.728633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.728921 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.729199 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.729917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.731554 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.742599 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1400/2825] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:23.746385 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.757074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccf4e-e562-4b0f-8a8d-30feb93141a8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.761650 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.762305 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.762624 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.762914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.763632 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.765237 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7bca-a0c3-4a7c-9a92-d849a731d434 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.776230 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1426/2826] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:23.780168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:23.790940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a1dc-0654-48a6-a0a4-3311de5ad8dd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:23.795581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:23.796456 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.796748 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.797030 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] PATH_INFO: `/v3/projects/ac69cf2484c546a892026ad5625c8127/users/561b14000cb445739d9b714428036c1a/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.811755 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac69cf2484c546a892026ad5625c8127, user_id=561b14000cb445739d9b714428036c1a, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:23.814428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:23.894267 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1401/2827] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:23 2022] PUT /identity/v3/projects/ac69cf2484c546a892026ad5625c8127/users/561b14000cb445739d9b714428036c1a/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:23.905243 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:23.905535 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:23.905988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:23.933541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] MFA Rules not processed for user `561b14000cb445739d9b714428036c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:23.934799 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:23.999858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1427/2828] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:24.004066 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.039581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:24.068464 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27532f5b-4265-4c58-81a0-bbc6625694f1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.073091 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.073756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.074041 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.074317 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.075025 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.076981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.153445 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1402/2829] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:24 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:24.157532 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.168704 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa19450-e712-4391-8fd9-88139bfd104d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.188669 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:24.226007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.226712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.226998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.227275 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.227969 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.229966 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.320540 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1428/2830] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:24 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:24.324629 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.335596 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62035-219b-4a37-9b12-a4309f32260c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.340952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.341602 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.341889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.342168 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.343341 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.344971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.356573 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1403/2831] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:24.360578 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.373765 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c94f-68ea-4a6c-9c24-2aca5994dbc6 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.378492 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.379375 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.380162 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.380674 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] PATH_INFO: `/v3/projects/fcb83728eaf2461d97723537f8abe97d/users/5325a9498b9e4daf9d7632a1521e537b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.397022 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb83728eaf2461d97723537f8abe97d, user_id=5325a9498b9e4daf9d7632a1521e537b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.399721 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.465712 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1429/2832] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:24 2022] PUT /identity/v3/projects/fcb83728eaf2461d97723537f8abe97d/users/5325a9498b9e4daf9d7632a1521e537b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:24.469633 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.480472 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d741-1ceb-47fa-8646-93a6d7a0a67e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.537658 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.538327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.538642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.538920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.539668 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.541294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e31c8-bd92-484e-b321-edc484678e45 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.550934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1404/2833] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:24.556393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.566336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c7f3b-9892-4595-ba22-af8daf3e7c33 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.571607 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.572417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.572701 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.572976 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] PATH_INFO: `/v3/projects/fcb83728eaf2461d97723537f8abe97d/users/5325a9498b9e4daf9d7632a1521e537b/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.574938 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb83728eaf2461d97723537f8abe97d, user_id=5325a9498b9e4daf9d7632a1521e537b, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.577549 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.588053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1430/2834] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:24 2022] PUT /identity/v3/projects/fcb83728eaf2461d97723537f8abe97d/users/5325a9498b9e4daf9d7632a1521e537b/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:24.599162 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.599457 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.600102 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.627835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] MFA Rules not processed for user `5325a9498b9e4daf9d7632a1521e537b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:24.629034 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:24.698360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1405/2835] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:24.709808 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.711538 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:24.767957 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef16b-d7c4-4460-a284-781c04aa41f4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.771844 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.772435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.772725 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.773007 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.782034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.783552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa338b-1cdc-4af9-b4cd-15c453e0a177 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:24.793742 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1431/2836] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 15:32:24.856519 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:24.887224 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:24.919046 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be8e2-093a-4388-aa4e-a82b4c460021 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:24.923691 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:24.924570 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:24.924859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:24.925142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] PATH_INFO: `/v3/users/561b14000cb445739d9b714428036c1a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:24.926370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561b14000cb445739d9b714428036c1a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:24.929067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:25.098520 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561b14000cb445739d9b714428036c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:25.099171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561b14000cb445739d9b714428036c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:25.176198 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561b14000cb445739d9b714428036c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:25.176814 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561b14000cb445739d9b714428036c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:25.189155 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561b14000cb445739d9b714428036c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:25.201017 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1406/2837] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:24 2022] DELETE /identity/v3/users/561b14000cb445739d9b714428036c1a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:25.205478 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:25.205769 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:25.206044 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:25.224313 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:25.226493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:25.286136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1432/2838] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:25.296391 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:25.297808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:25.356016 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f77e6-c6c3-45fa-ab5a-44a823fd47c1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:25.359585 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:25.360227 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:25.360508 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:25.360789 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:25.369822 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:25.371269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:25.380595 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1407/2839] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:25.770518 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:25.772612 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:25.787072 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091e5fe-fd7b-4d60-a0e1-bd94a15ba3f7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:25.791988 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:25.792925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:25.793217 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:25.793528 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] PATH_INFO: `/v3/projects/ac69cf2484c546a892026ad5625c8127` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:25.794776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac69cf2484c546a892026ad5625c8127)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:25.796729 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:25.813382 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:25.941153 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac69cf2484c546a892026ad5625c8127', 'request_id': 'req-95faa0f0-20d2-4df1-9eea-b8ffea10d815'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.008250 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac69cf2484c546a892026ad5625c8127', 'request_id': 'req-95faa0f0-20d2-4df1-9eea-b8ffea10d815'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.014352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac69cf2484c546a892026ad5625c8127', 'request_id': 'req-95faa0f0-20d2-4df1-9eea-b8ffea10d815'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.025920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] The token cache is being invalidate because project ac69cf2484c546a892026ad5625c8127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:26.026208 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.026923 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.028527 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1433/2840] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:25 2022] DELETE /identity/v3/projects/ac69cf2484c546a892026ad5625c8127 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:26.032525 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:26.042355 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7e65-17b1-4870-97c7-67243489870c service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:26.089085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:26.104225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:26.112171 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:26.112911 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:26.113201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] PATH_INFO: `/v3/users/5325a9498b9e4daf9d7632a1521e537b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:26.114452 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5325a9498b9e4daf9d7632a1521e537b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:26.117032 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:26.299370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5325a9498b9e4daf9d7632a1521e537b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.300021 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5325a9498b9e4daf9d7632a1521e537b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.370753 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5325a9498b9e4daf9d7632a1521e537b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.371384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5325a9498b9e4daf9d7632a1521e537b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.384458 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef4221a2-d8ab-4811-99b8-3e58ebf62c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5325a9498b9e4daf9d7632a1521e537b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:26.397077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1408/2841] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:26 2022] DELETE /identity/v3/users/5325a9498b9e4daf9d7632a1521e537b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:26.921334 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:26.922837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:26.936920 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa0f0-20d2-4df1-9eea-b8ffea10d815 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:26.998896 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:26.999813 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.000103 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.000457 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] PATH_INFO: `/v3/projects/fcb83728eaf2461d97723537f8abe97d` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.001608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb83728eaf2461d97723537f8abe97d)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.003629 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.125310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb83728eaf2461d97723537f8abe97d', 'request_id': 'req-d5079e69-faac-4b4f-9dcf-0c7e3144f344'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:27.180155 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb83728eaf2461d97723537f8abe97d', 'request_id': 'req-d5079e69-faac-4b4f-9dcf-0c7e3144f344'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:27.185998 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb83728eaf2461d97723537f8abe97d', 'request_id': 'req-d5079e69-faac-4b4f-9dcf-0c7e3144f344'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:27.197724 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] The token cache is being invalidate because project fcb83728eaf2461d97723537f8abe97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:27.198015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:27.198675 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-d5079e69-faac-4b4f-9dcf-0c7e3144f344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:27.200211 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1434/2842] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:26 2022] DELETE /identity/v3/projects/fcb83728eaf2461d97723537f8abe97d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:27.215527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.216077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.216077 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.233979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:27.235215 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:27.296425 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1409/2843] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:27.304429 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.304754 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.305040 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.324435 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:27.325673 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:27.333566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1435/2844] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:27.338894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.348655 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6ed3e-f68c-4608-a425-ac89f3551077 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.353467 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.354118 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.354434 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.354715 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.355483 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:27.355810 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.357404 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.369640 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1410/2845] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:32:27.373651 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.384024 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162b2a-e3b1-4d7e-abfb-525347500f11 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.388672 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.389323 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.389610 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.389892 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.390618 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.392504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.469031 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1436/2846] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:27.473057 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.483049 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2517-e993-473e-88d3-79dae42c0e96 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.533591 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:27.539697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.540361 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.540646 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.540952 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.541674 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.543632 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.617941 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1411/2847] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/users => generated 304 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:27.622264 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.628959 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:27.633652 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d12c2-9b95-4d3a-a3a8-b35cf8307338 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.638436 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.640514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.640514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.640514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.640514 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.642028 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.652911 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1437/2848] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:27.656973 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.667981 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43543420-7dc8-4d76-be65-f2047a49b969 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.672545 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.673196 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.673478 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.673757 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.674535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.676143 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c4ba-69e0-4a5a-9bcf-b5496b5de811 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.687503 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1412/2849] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:27.691523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.702085 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb09f5-8b43-4dfe-aca3-a6607bc41ea1 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.706643 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.707513 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.707794 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.708068 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] PATH_INFO: `/v3/projects/5ecf38dd177945bb90fc432964eec0d1/users/f0b18f29e0794ccd8ae98f4002f0e812/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.726807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecf38dd177945bb90fc432964eec0d1, user_id=f0b18f29e0794ccd8ae98f4002f0e812, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.726807 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:27.819740 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1438/2850] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:27 2022] PUT /identity/v3/projects/5ecf38dd177945bb90fc432964eec0d1/users/f0b18f29e0794ccd8ae98f4002f0e812/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:27.830020 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.830294 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.830628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.857132 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] MFA Rules not processed for user `f0b18f29e0794ccd8ae98f4002f0e812`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:27.858384 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:27.922116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1413/2851] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:27.926679 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:27.988855 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2179fb-2a1f-49ce-b710-439171b0fe67 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:27.994259 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:27.994940 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:27.995225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:27.995504 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:27.996190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:27.998123 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.103860 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1439/2852] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:27 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:28.109370 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.119873 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61e51-2bce-4e1f-b56b-7ce3c8a1a00b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.177931 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.178628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.178922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.179936 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.180619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.182575 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.262934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1414/2853] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:28 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:28.266816 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.279768 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4051-b583-4c6c-87e9-42016351c771 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.294214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.294914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.295198 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.295567 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.296333 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.297934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.309168 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1440/2854] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:28.313322 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.323649 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacd21c-1d49-4d46-8eb2-07f1ea5a3c4a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.328193 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.329067 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.329379 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.329651 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] PATH_INFO: `/v3/projects/90641b32f1df4b3e9a1be6967221ecae/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.344870 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90641b32f1df4b3e9a1be6967221ecae, user_id=e3b8c9d5eafb4883aace6f5ad0c3b8a4, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.347558 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.445420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1415/2855] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:28 2022] PUT /identity/v3/projects/90641b32f1df4b3e9a1be6967221ecae/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:32:28.449398 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.459541 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6107-4875-4875-9678-088b30715883 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.515034 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.515654 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.515945 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.516227 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.516943 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.518566 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97347-a3a4-4428-a0f3-bf4e131bef2a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.528747 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1441/2856] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:28.532925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.543377 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a98654-dc4d-4cea-b7be-b6ad09430582 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.548028 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.548937 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.549223 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.549500 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] PATH_INFO: `/v3/projects/90641b32f1df4b3e9a1be6967221ecae/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.551528 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90641b32f1df4b3e9a1be6967221ecae, user_id=e3b8c9d5eafb4883aace6f5ad0c3b8a4, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.554484 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.564667 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1416/2857] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:28 2022] PUT /identity/v3/projects/90641b32f1df4b3e9a1be6967221ecae/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:28.586360 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.586711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.586997 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.613581 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] MFA Rules not processed for user `e3b8c9d5eafb4883aace6f5ad0c3b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:28.614821 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:28.643639 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:28.684994 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1442/2858] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:28.695572 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:28.697271 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:28.718022 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:28.754731 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a17c-532f-440f-b454-8f2d715fd37c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:28.758762 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:28.759406 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:28.759697 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:28.759979 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:28.769628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:28.771051 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:28.780732 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1417/2859] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:29.113448 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:29.124173 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed76c-0349-4d7f-8f92-a2dda0c8473d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:29.127800 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:29.128446 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:29.128735 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:29.129013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:29.186122 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:29.187661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02d2d-ef7e-4b24-8e8c-c96e1d326867 service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:29.197167 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1443/2860] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:35.890252 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:35.953157 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c7bb-872d-4891-97cf-084df8f6217a service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:35.957740 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:35.958652 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:35.958939 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:35.959219 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] PATH_INFO: `/v3/users/f0b18f29e0794ccd8ae98f4002f0e812` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:35.960399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b18f29e0794ccd8ae98f4002f0e812)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:35.962320 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:36.138486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b18f29e0794ccd8ae98f4002f0e812'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:36.139072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b18f29e0794ccd8ae98f4002f0e812'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:36.204792 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b18f29e0794ccd8ae98f4002f0e812'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:36.205407 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b18f29e0794ccd8ae98f4002f0e812'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:36.218857 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b18f29e0794ccd8ae98f4002f0e812'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:36.231104 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1418/2861] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:35 2022] DELETE /identity/v3/users/f0b18f29e0794ccd8ae98f4002f0e812 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:36.235826 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:36.236355 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:36.236468 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:36.253719 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:36.254954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:36.313883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1444/2862] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:32:36.323994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:36.325448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:36.368864 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:36.382917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23264-da5e-4db1-b309-1929afa383d8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:36.387723 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:36.388365 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:36.388700 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:36.388926 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:36.397843 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:36.399726 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:36.410033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1419/2863] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:36.813161 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:36.814604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:36.827788 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6de01-4eec-408c-9d96-04adf41f1431 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:36.832522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128638-887c-4534-b079-587c68367085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:36.833487 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128638-887c-4534-b079-587c68367085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:36.833684 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128638-887c-4534-b079-587c68367085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:36.833960 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128638-887c-4534-b079-587c68367085 admin admin] PATH_INFO: `/v3/projects/5ecf38dd177945bb90fc432964eec0d1` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:36.835425 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128638-887c-4534-b079-587c68367085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecf38dd177945bb90fc432964eec0d1)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:36.837778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128638-887c-4534-b079-587c68367085 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:36.938159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecf38dd177945bb90fc432964eec0d1', 'request_id': 'req-60128638-887c-4534-b079-587c68367085'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.025201 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecf38dd177945bb90fc432964eec0d1', 'request_id': 'req-60128638-887c-4534-b079-587c68367085'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.028568 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:37.032431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecf38dd177945bb90fc432964eec0d1', 'request_id': 'req-60128638-887c-4534-b079-587c68367085'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.044530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] The token cache is being invalidate because project 5ecf38dd177945bb90fc432964eec0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:37.044822 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.045455 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-60128638-887c-4534-b079-587c68367085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.047100 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1445/2864] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:36 2022] DELETE /identity/v3/projects/5ecf38dd177945bb90fc432964eec0d1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:37.051203 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:37.061177 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65104a-f41d-44ee-b7ec-fc1216e09afb service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:37.120468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:37.121343 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:37.121669 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:37.121949 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] PATH_INFO: `/v3/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:37.123172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b8c9d5eafb4883aace6f5ad0c3b8a4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:37.125096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:37.290148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b8c9d5eafb4883aace6f5ad0c3b8a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.290831 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b8c9d5eafb4883aace6f5ad0c3b8a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.379354 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b8c9d5eafb4883aace6f5ad0c3b8a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.379985 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b8c9d5eafb4883aace6f5ad0c3b8a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.392766 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-674781a8-737c-42e3-95b4-c523300254aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b8c9d5eafb4883aace6f5ad0c3b8a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:37.405635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1420/2865] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:37 2022] DELETE /identity/v3/users/e3b8c9d5eafb4883aace6f5ad0c3b8a4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:37.800776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128638-887c-4534-b079-587c68367085 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:37.802302 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-60128638-887c-4534-b079-587c68367085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:37.819621 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128638-887c-4534-b079-587c68367085 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:37.879819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:37.880688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:37.880971 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:37.881240 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] PATH_INFO: `/v3/projects/90641b32f1df4b3e9a1be6967221ecae` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:37.882454 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90641b32f1df4b3e9a1be6967221ecae)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:37.884418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:37.994196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90641b32f1df4b3e9a1be6967221ecae', 'request_id': 'req-c2c2706e-2bc2-4bb9-80a7-05462d32418a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:38.073418 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90641b32f1df4b3e9a1be6967221ecae', 'request_id': 'req-c2c2706e-2bc2-4bb9-80a7-05462d32418a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:38.079790 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90641b32f1df4b3e9a1be6967221ecae', 'request_id': 'req-c2c2706e-2bc2-4bb9-80a7-05462d32418a'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:38.091316 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] The token cache is being invalidate because project 90641b32f1df4b3e9a1be6967221ecae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:38.091602 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:38.093097 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c2c2706e-2bc2-4bb9-80a7-05462d32418a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:38.093935 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1446/2866] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:37 2022] DELETE /identity/v3/projects/90641b32f1df4b3e9a1be6967221ecae => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:38.098904 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.099376 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.099479 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.118679 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:38.119901 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:38.178617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1421/2867] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:38.187548 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.187838 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.188114 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.206213 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:38.207431 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:38.215512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1447/2868] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:38.219594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.224487 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:38.229648 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b421a-b06b-48cf-bb48-0e670b5fb57d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.235018 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.238308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.238308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.238308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.238308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:38.238308 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.238874 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.250966 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1422/2869] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 15:32:38.255265 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.267574 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db2c57-eea4-4ea9-b8a4-ab6f1879ab53 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.275018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.275018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.275018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.275018 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.275580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.275580 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.347711 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1448/2870] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:38.351944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.362729 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b9dd-9b89-45d8-9d9e-0242cc439e33 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.419185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.419852 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.420136 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.420412 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.421125 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.423098 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.493253 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1423/2871] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:38.497482 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.507817 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312fab8-e20f-4229-a71c-1291f71b09c9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.512466 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.513118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.513417 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.513692 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.514433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.516013 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.526267 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1449/2872] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:38.530881 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.540761 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afb05-7646-4e77-be00-f11b77e7c8f2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.546176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.546858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.547147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.547428 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.548147 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.549760 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5646d-c9c0-45a1-a7ad-9999856177b2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.559893 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1424/2873] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:38.563922 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.573615 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e014-8de2-4146-b766-dc1145bfdead admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.578185 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.579083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.579391 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.579664 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] PATH_INFO: `/v3/projects/816e9f1a35da4da2b1d00da9ce963c44/users/b1545d6ee65649dfb608b0102054a461/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.594762 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=816e9f1a35da4da2b1d00da9ce963c44, user_id=b1545d6ee65649dfb608b0102054a461, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.597428 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:38.666354 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1450/2874] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:38 2022] PUT /identity/v3/projects/816e9f1a35da4da2b1d00da9ce963c44/users/b1545d6ee65649dfb608b0102054a461/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:38.729214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.729637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.730505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.757993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] MFA Rules not processed for user `b1545d6ee65649dfb608b0102054a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:38.759241 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:38.823735 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1425/2875] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:38.828294 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:38.841925 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:38.889914 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2f9b-4fd7-4bba-9b1e-baa72809f6be admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:38.894589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:38.895251 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:38.895534 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:38.895814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:38.896505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:38.898476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.023272 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1451/2876] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:39.027999 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.038637 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf813bc-75eb-4662-9172-83d4dadcc830 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.088993 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:39.095229 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.095894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.096175 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.096448 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.097128 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.099072 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.187848 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1426/2877] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:39 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:39.191852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.203107 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eef5d-77c9-49b5-a919-eac564fd798b admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.207688 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.208341 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.208733 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.209015 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.209780 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.211404 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.222743 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1452/2878] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:39.226583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.236920 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc009cc-4467-4938-aa6e-19dbcd2cfe24 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.241538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.242192 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.242505 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.242786 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.243510 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.245094 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec712-8e5e-457d-b516-67e318f43365 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.256033 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1427/2879] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:39.260105 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.271412 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59361-6826-4878-a730-0ead912590f4 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.276849 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.277852 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.278136 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.278469 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] PATH_INFO: `/v3/projects/74164299d73748978ae5561f629b0955/users/00daf781223f44018c15c0698511f001/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.293894 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74164299d73748978ae5561f629b0955, user_id=00daf781223f44018c15c0698511f001, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.296588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.374734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1453/2880] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:39 2022] PUT /identity/v3/projects/74164299d73748978ae5561f629b0955/users/00daf781223f44018c15c0698511f001/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:39.384895 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.385185 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.385466 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.413037 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] MFA Rules not processed for user `00daf781223f44018c15c0698511f001`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:39.414238 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:39.479675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1428/2881] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:39.485205 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.547617 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8168-bacc-4710-ab27-d2b788e70de7 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.552141 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.552802 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.553083 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.553368 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.554079 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.556298 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.635048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1454/2882] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:39 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:39.639705 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.650440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94531-bbcc-47d5-a292-26995368ab39 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.707527 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.708197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.708486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.708763 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.709435 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.711427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.785468 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1429/2883] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:39 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:32:39.789512 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.800510 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2d17b-f9aa-45a1-b705-f007a5288f24 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.805480 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.806163 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.806476 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.806783 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.807523 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.809190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.819778 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1455/2884] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:39.824470 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.834619 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d81401-2457-48f8-94d6-28d1f564ec85 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:39.839906 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:39.840886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:39.841156 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:39.841567 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] PATH_INFO: `/v3/projects/c15fcffac091431cad6de9c7e00d5136/users/5bd200ef19454c1facfd7caa4b239575/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:39.856214 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15fcffac091431cad6de9c7e00d5136, user_id=5bd200ef19454c1facfd7caa4b239575, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:39.858890 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:39.965116 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1430/2885] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:39 2022] PUT /identity/v3/projects/c15fcffac091431cad6de9c7e00d5136/users/5bd200ef19454c1facfd7caa4b239575/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 15:32:39.969327 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:39.979340 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81892309-c624-45b2-9fc0-56f6c1a461e8 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:40.012500 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:40.034731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:40.035394 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:40.035678 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:40.035986 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:40.036734 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:40.038338 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585ea40-48c6-4e77-a7b5-6fa301548c49 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:40.048588 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1456/2886] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:40.053226 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:40.064182 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ff86d-6b75-4d95-acbc-61b7cc4f6757 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:40.068827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:40.069706 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:40.069991 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:40.070272 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] PATH_INFO: `/v3/projects/c15fcffac091431cad6de9c7e00d5136/users/5bd200ef19454c1facfd7caa4b239575/roles/b95ee83688ee4a2f9c8598baac92e53a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:40.072280 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15fcffac091431cad6de9c7e00d5136, user_id=5bd200ef19454c1facfd7caa4b239575, role_id=b95ee83688ee4a2f9c8598baac92e53a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:40.075560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:40.086052 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1431/2887] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:40 2022] PUT /identity/v3/projects/c15fcffac091431cad6de9c7e00d5136/users/5bd200ef19454c1facfd7caa4b239575/roles/b95ee83688ee4a2f9c8598baac92e53a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:40.096317 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:40.096608 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:40.096882 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:40.123053 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] MFA Rules not processed for user `5bd200ef19454c1facfd7caa4b239575`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:40.124246 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:40.194001 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1457/2888] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:40.205675 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:40.207380 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:40.232769 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:40.277084 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0be52-11cf-4a17-ba0c-fce1cd22c532 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:40.280902 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:40.281549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:40.281835 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:40.282115 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:40.291917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:40.293366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:40.302917 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1432/2889] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:40.409677 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:40.411108 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:40.423731 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdc740-6433-4bd0-9038-e7af1ecb12c7 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:40.427573 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:40.428224 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:40.432081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:40.432081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:40.484934 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:40.486350 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12465-1a90-46bb-ba3d-20107ff2256f service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:40.494992 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1458/2890] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:44.437450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:44.523400 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cfa8-91aa-4ae9-b1fb-ebf13fe405bb service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:44.527918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:44.528787 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:44.529071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:44.529898 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] PATH_INFO: `/v3/users/b1545d6ee65649dfb608b0102054a461` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:44.531133 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1545d6ee65649dfb608b0102054a461)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:44.533062 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:44.725275 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1545d6ee65649dfb608b0102054a461'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:44.725923 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1545d6ee65649dfb608b0102054a461'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:44.828150 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1545d6ee65649dfb608b0102054a461'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:44.828994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1545d6ee65649dfb608b0102054a461'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:44.841992 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1545d6ee65649dfb608b0102054a461'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:44.854994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1433/2891] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:44 2022] DELETE /identity/v3/users/b1545d6ee65649dfb608b0102054a461 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:44.860214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:44.860722 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:44.860837 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:44.900473 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:44.901661 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:44.934609 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=100 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:44.961825 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1459/2892] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 15:32:44.971374 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:44.972804 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:44.992408 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:45.044594 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eafdfc-1c24-41c2-9734-a1225d94aff3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:45.049208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:45.049859 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:45.050142 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:45.050440 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:45.060222 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:45.062366 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:45.071744 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1434/2893] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:45.463336 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:45.464761 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:45.477219 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70c46e-273b-42e0-80c1-3e85a5953c29 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:45.481902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:45.483432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:45.483705 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:45.483985 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] PATH_INFO: `/v3/projects/816e9f1a35da4da2b1d00da9ce963c44` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:45.485169 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816e9f1a35da4da2b1d00da9ce963c44)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:45.487118 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:45.631536 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816e9f1a35da4da2b1d00da9ce963c44', 'request_id': 'req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.716322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816e9f1a35da4da2b1d00da9ce963c44', 'request_id': 'req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.722786 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816e9f1a35da4da2b1d00da9ce963c44', 'request_id': 'req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.734058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] The token cache is being invalidate because project 816e9f1a35da4da2b1d00da9ce963c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:45.734346 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.735009 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.736562 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1460/2894] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:45 2022] DELETE /identity/v3/projects/816e9f1a35da4da2b1d00da9ce963c44 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:45.740617 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:45.751081 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e54ef-7154-47b0-81a9-fd9ba9f5a1f1 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:45.807867 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:45.808727 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:45.809008 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:45.809278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] PATH_INFO: `/v3/users/00daf781223f44018c15c0698511f001` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:45.810495 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00daf781223f44018c15c0698511f001)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:45.812462 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:45.956642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00daf781223f44018c15c0698511f001'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:45.957338 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00daf781223f44018c15c0698511f001'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.016176 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00daf781223f44018c15c0698511f001'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.016774 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00daf781223f44018c15c0698511f001'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.029450 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00daf781223f44018c15c0698511f001'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.042096 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1435/2895] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:45 2022] DELETE /identity/v3/users/00daf781223f44018c15c0698511f001 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:46.458288 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:46.459767 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:46.473489 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aaf14-8ebc-44c3-ae7b-3e1d1581f662 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:46.532589 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:46.533499 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:46.533782 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:46.534058 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] PATH_INFO: `/v3/projects/74164299d73748978ae5561f629b0955` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:46.535309 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74164299d73748978ae5561f629b0955)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:46.537183 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:46.648393 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74164299d73748978ae5561f629b0955', 'request_id': 'req-833936bd-8909-47c7-b7c5-860033fa500e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.762753 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74164299d73748978ae5561f629b0955', 'request_id': 'req-833936bd-8909-47c7-b7c5-860033fa500e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.768604 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:46.769918 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74164299d73748978ae5561f629b0955', 'request_id': 'req-833936bd-8909-47c7-b7c5-860033fa500e'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.781522 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] The token cache is being invalidate because project 74164299d73748978ae5561f629b0955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:46.781814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.782491 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:46.784048 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1461/2896] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:46 2022] DELETE /identity/v3/projects/74164299d73748978ae5561f629b0955 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:46.787994 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:46.789427 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:46.802172 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c0722-4be9-4ca3-87c7-653fa1319e3f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:46.820918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:46.858170 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:46.859075 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:46.859360 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:46.859636 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] PATH_INFO: `/v3/users/5bd200ef19454c1facfd7caa4b239575` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:46.860808 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd200ef19454c1facfd7caa4b239575)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:46.862785 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:47.084055 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd200ef19454c1facfd7caa4b239575'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.084628 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd200ef19454c1facfd7caa4b239575'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.173549 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd200ef19454c1facfd7caa4b239575'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.174212 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd200ef19454c1facfd7caa4b239575'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.187565 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-33943bf5-ae4d-4557-9fa7-d36a1482f708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd200ef19454c1facfd7caa4b239575'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.199576 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1436/2897] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:32:46 2022] DELETE /identity/v3/users/5bd200ef19454c1facfd7caa4b239575 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:47.589410 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:47.590937 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:47.614281 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833936bd-8909-47c7-b7c5-860033fa500e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:47.680126 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:47.680995 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:47.681278 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:47.681552 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] PATH_INFO: `/v3/projects/c15fcffac091431cad6de9c7e00d5136` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:47.682750 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15fcffac091431cad6de9c7e00d5136)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:47.684647 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:47.790776 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15fcffac091431cad6de9c7e00d5136', 'request_id': 'req-a9db6833-bbbd-4859-a695-ae59e1f6f087'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.861933 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15fcffac091431cad6de9c7e00d5136', 'request_id': 'req-a9db6833-bbbd-4859-a695-ae59e1f6f087'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.868010 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15fcffac091431cad6de9c7e00d5136', 'request_id': 'req-a9db6833-bbbd-4859-a695-ae59e1f6f087'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.881577 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] The token cache is being invalidate because project c15fcffac091431cad6de9c7e00d5136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:32:47.881861 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.882530 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-a9db6833-bbbd-4859-a695-ae59e1f6f087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:32:47.884093 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1462/2898] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:32:47 2022] DELETE /identity/v3/projects/c15fcffac091431cad6de9c7e00d5136 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:47.890581 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:47.891095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:47.891210 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:47.909922 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:47.910579 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:47.970095 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1437/2899] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:47.979506 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:47.979795 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:47.980074 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:47.999745 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:48.000958 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:48.008858 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1463/2900] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:48.012894 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.022642 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e7e59-3971-4a69-9e7f-977733921b33 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.027293 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.027971 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.028254 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.028531 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.029278 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 15:32:48.029604 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.031269 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.042779 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1438/2901] 10.222.0.74 () {58 vars in 1152 bytes} [Fri May 27 15:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 15:32:48.047883 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.057189 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332180-b1bd-418b-8d96-c14f3afe357d None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.062505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.063149 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.063433 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.063714 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.064406 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.066283 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.143505 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1464/2902] 10.222.0.74 () {60 vars in 1152 bytes} [Fri May 27 15:32:48 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 15:32:48.147459 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.157807 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c527b4-a4bd-4c66-8443-ff6248470367 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.183746 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:48.213955 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.214644 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.214927 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.215233 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.215918 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.219496 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.319402 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1439/2903] 10.222.0.74 () {60 vars in 1143 bytes} [Fri May 27 15:32:48 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 15:32:48.323666 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.333954 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574284-f7b8-4569-ad77-63e72e8746d9 admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.338691 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.339342 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.339625 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.339902 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.340619 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.342774 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.353081 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1465/2904] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:48.356925 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.367750 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cfe3-cfc7-48a2-b6cd-de5549511e38 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.372353 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.373560 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.373869 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.374153 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.374940 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.376535 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1517-f34a-4d6c-ae8f-ed95e74d50d8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.388538 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1440/2905] 10.222.0.74 () {58 vars in 1121 bytes} [Fri May 27 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 15:32:48.391023 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.401019 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640b33-4a49-4fe0-b4bf-4f1497744b6f admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.406254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.407159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.407451 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.407730 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] PATH_INFO: `/v3/projects/41f57a5a793941c7b5fd65b31f982ef2/users/078588737f0f468799a24a4b8fbfcd04/roles/239334dd0e7f463ea1f77dce601caeff` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.422848 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f57a5a793941c7b5fd65b31f982ef2, user_id=078588737f0f468799a24a4b8fbfcd04, role_id=239334dd0e7f463ea1f77dce601caeff)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.425496 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.484432 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:48.489071 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1466/2906] 10.222.0.74 () {60 vars in 1482 bytes} [Fri May 27 15:32:48 2022] PUT /identity/v3/projects/41f57a5a793941c7b5fd65b31f982ef2/users/078588737f0f468799a24a4b8fbfcd04/roles/239334dd0e7f463ea1f77dce601caeff => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:32:48.500268 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.500635 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.500944 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.527071 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] MFA Rules not processed for user `078588737f0f468799a24a4b8fbfcd04`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:32:48.528583 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:48.593712 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1441/2907] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:32:48.604638 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:32:48.606367 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:32:48.663696 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef363ae-17e1-49f4-9909-5e3ce95e0f0e admin admin] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:32:48.667254 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2be3143a237450a80f2fcb01a0c2e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:32:48.667897 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] REQUEST_METHOD: `GET` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:32:48.668178 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:32:48.668452 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:32:48.676814 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:32:48.678310 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f6d4-3432-43e4-8278-9fd81b22420f service cinder] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:32:48.688064 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1467/2908] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:32:58.589889 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:58.683819 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=26 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:00.340378 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:33:00.401976 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab58a8-764c-4d39-aa6e-c9c844cf573b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:33:00.406892 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:33:00.407764 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:33:00.408048 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:33:00.408327 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] PATH_INFO: `/v3/users/078588737f0f468799a24a4b8fbfcd04` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:33:00.409512 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078588737f0f468799a24a4b8fbfcd04)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:33:00.411486 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:33:00.575943 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078588737f0f468799a24a4b8fbfcd04'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:00.576526 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078588737f0f468799a24a4b8fbfcd04'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:00.636285 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078588737f0f468799a24a4b8fbfcd04'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:00.636934 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078588737f0f468799a24a4b8fbfcd04'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:00.649587 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078588737f0f468799a24a4b8fbfcd04'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:00.661710 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1442/2909] 10.222.0.74 () {58 vars in 1223 bytes} [Fri May 27 15:33:00 2022] DELETE /identity/v3/users/078588737f0f468799a24a4b8fbfcd04 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:33:00.666196 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] REQUEST_METHOD: `POST` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:33:00.666784 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:33:00.666784 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:33:00.693961 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.auth.core [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] MFA Rules not processed for user `90db34a522d24d0a8b320230ceed48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 15:33:00.695214 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:33:00.752477 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1468/2910] 10.222.0.74 () {58 vars in 957 bytes} [Fri May 27 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 15:33:00.762038 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:33:00.766274 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:33:00.843638 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40776309-18f0-4467-bfa9-d036e95cff98 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:33:00.847430 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec341a30b5274ebc9b12e0bdad2ed8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:33:00.848085 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:33:00.848399 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:33:00.848678 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:33:00.857827 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:33:00.860395 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:33:00.869912 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1443/2911] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:33:01.292326 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] Authenticating user token {{(pid=80536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:33:01.294403 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.fernet_utils [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:33:01.305917 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71c49-e453-4d7b-a018-7f42691df576 None None] Validating token access rules against request {{(pid=80536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:33:01.310493 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db34a522d24d0a8b320230ceed48a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96792dba09744fc9ab793949f57108dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:33:01.311352 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:33:01.311636 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:33:01.312002 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] PATH_INFO: `/v3/projects/41f57a5a793941c7b5fd65b31f982ef2` {{(pid=80536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:33:01.315190 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f57a5a793941c7b5fd65b31f982ef2)` {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:33:01.317036 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] RBAC: Authorization granted {{(pid=80536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:33:01.422212 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f57a5a793941c7b5fd65b31f982ef2', 'request_id': 'req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:01.479159 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f57a5a793941c7b5fd65b31f982ef2', 'request_id': 'req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:01.485322 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f57a5a793941c7b5fd65b31f982ef2', 'request_id': 'req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44'} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:01.496225 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] The token cache is being invalidate because project 41f57a5a793941c7b5fd65b31f982ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 15:33:01.496511 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:01.501353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG keystone.notifications [None req-c1f6eba8-ff72-4abe-bdb8-303de8f8dd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 15:33:01.501353 dv-cinder-842542-2-smb devstack@keystone.service[80536]: [pid: 80536|app: 0|req: 1469/2912] 10.222.0.74 () {58 vars in 1232 bytes} [Fri May 27 15:33:01 2022] DELETE /identity/v3/projects/41f57a5a793941c7b5fd65b31f982ef2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 15:33:10.865660 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:11.493263 dv-cinder-842542-2-smb devstack@keystone.service[80536]: DEBUG dbcounter [-] [80536] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:21.658756 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 15:35:21.660197 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:35:21.749924 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ca31-0b21-4ee3-ae26-02083879c33f service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 15:35:21.808201 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea4efcee73dd41089b084d21f5cd5005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63aab9b7eef342e58c0d85fa393184f7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 15:35:21.808858 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 15:35:21.809146 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 15:35:21.809420 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 15:35:21.811225 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 15:35:21.822537 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 15:35:21.824208 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797860-9717-41dc-8af8-686617dc7932 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 15:35:21.835148 dv-cinder-842542-2-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1444/2913] 10.222.0.74 () {60 vars in 1365 bytes} [Fri May 27 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 15:35:31.829886 dv-cinder-842542-2-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=67 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}